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(TIMSS) is the largest, most comprehensive, and most rigorous 
international comparison of education ever undertaken. During the 
1995 school year, the study tested the mathematics and science 
knowledge of a half-million students from 41 nations at five 
different grade levels. In addition to tests and questionnaires, the 
TIMSS included a curriculum analysis, videotaped observations of 
mathematics classrooms, and case studies of policy issues. This 
report on eighth-grade students is one of a series of reports that 
will also present findings on student achievement at fourth-grade 
level, at the end of high school, as well as on various other topics. 
The report combines the major findings from each of the five parts of 
the study into a single story about U.S. eighth-grade mathematics and 
science achievement in a comparative perspective. Chapter 1 draws 
from the results of the student assessments to describe how U.S. 
students perform in mathematics and science. Succeeding chapters 
focus on factors which may have an important influence on 
achievement, and describe how our nation's schools, teachers, and 
students compare to those in other countries. Chapter 2 examines 
educational standards and the curriculum, based on data from the 
curriculum analysis, case studies, videotape study, and 
questionnaires. Chapter 3 focuses on how teachers actually teach the 
curriculum, drawing from results of the videotape study and 
questionnaires. Chapter 4 examines the working life of teachers, 
based on findings from the case studies and questionnaires. Chapter 5 
describes the lives of students, both in and out of school, based 
upon case study and questionnaire data. The conclusions at the end of 
the report look across all of the findings for insights about factors 
associated with student performance and indicate questions for 
further study. (JRH) 
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C O MMISSION E R ' S 
STATE M E N T 



With data on half a million students from 41 countries, the Third Interna- 
tional Mathematics and Science Study (TIMSS) is the largest, most compre- 
hensive, and most rigorous international study of schools and students ever. 
This report, Pursuing Excellence , is a synthesis of initial findings from TIMSS 
on U.S. eighth-grade mathematics and science education, providing a comparative 
picture of education in the United States and the world that can be used to exam- 
ine our education system, scrutinize improvement plans, and evaluate proposed 
standards and curricula. Subsequent TIMSS reports will examine U.S. mathemat- 
ics and science education for fourth and twelfth-grade students in an international 
context, 

TIMSS is significant not only because of its scope and magnitude, but also 
because of innovations in its design. In this international study, the National 
Center for Education Statistics (NCES) combined multiple methodologies to 
create an information base that goes beyond simple student test score compari- 
sons and questionnaires to examine the fundamental elements of schooling. In- 
novative research techniques include analyses of textbooks and curricula, video- 
tapes, and ethnographic case studies. The result is a more complete and 
accurate portrait of how U.S. mathematics and science education differs 
from that of other nations, with extended comparisons to Germany and Ja- 
pan. 

The information in these reports can serve as a starting point for our efforts to 
define a “world-class” education. If the U.S. is to improve the mathematics and 
science education of its students, we must carefully examine not just how other 
countries rank, but also how their polices and practices help student achieve. 
TIMSS shows us where U.S. education stands — not just in terms of test scores, 
but also what is included in textbooks, taught in schools, and learned by 
students. Examining these data provides a unique opportunity to shed new light 
on education in the United States through the prism of other countries. As 
the same time, we should avoid the temptation to zero in on any one finding 
or leap to a conclusion without carefully considering the broader context. 

This report is only the first of many NCES investigations into TIMSS data. 
Additional reports will be released throughout the coming year, including 
linkages of student achievement in U.S. states to achievement in the TIMSS 
countries, as well as findings on fourth and twelfth grade students. More- 
over, NCES plans to make TIMSS the most accessible international educa- 
tion study ever by releasing the data to scholars and the research commu- 
nity, and actively disseminating the findings to policymakers, educators, 
parents, and others concerned with quality education. Beginning with this 
report, NCES is releasing the information in a variety of new forms, includ- 
ing CD-ROM, videotape, and the World-Wide Web. Visit the NCES TIMSS 
website at “http://www. ed.gov/NCES/timss” for further information. 
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In all these efforts, our purpose is not just to take a snapshot of the present, 
but to develop a valuable resource for school improvement efforts. TIMSS 
clearly and accurately provides a wealth of useful data and information on 
curriculum, instruction, teacher and student lives, and student achieve- 
ment. The investment in TIMSS can enhance the quality of our nation’s 
mathematics and science education, and improve the performance of our 
students to a more internationally competitive level. 




Pascal D. Forgione Jr. 

Commissioner of Education Statistics 
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EXECUTIV E 

SUMMARY 



PREFACE 

The Third International Mathematics 
and Science Study (TIMSS) is the larg- 
est, most comprehensive, and most rig- 
orous international comparison of edu- 
cation ever undertaken. During the 
1 995 school year, the study tested the 
math and science knowledge of a half- 
million students from 4 1 nations at five 
different grade levels. In addition to 
tests and questionnaires, it included a 
curriculum analysis, videotaped obser- 
vations of mathematics classrooms, and 
case studies of policy issues. 

■ TIMSS’ rich information allows us 
not only to compare achievement, 
but also provides insights into how 
life in U.S. schools differs from that 
in other nations. 

■ This report on eighth-grade students 
is one of a series of reports that will 
also present findings on student 
achievement at fourth grade, and at 
the end of high school, as well as on 
various other topics. 



■ In science, U.S. eighth graders 
score above the international av- 
erage of 41 TIMSS countries. Our 
students’ scores are not signifi- 
cantly different from those of 
Canada, England, and Germany. 

■ In mathematics, our eighth-grade 
students’ standing is at about the 
international average in Algebra; 
Fractions; and Data Representa- 
tion, Analysis, and Probability. We 
do less well in Geometry; Measure- 
ment; and Proportionality. 

■ In science, our eighth graders’ 
standing is above the international 
average in Earth Science, Life Sci- 
ence, and Environmental Issues. 
Our students score about average 
in Chemistry and Physics. 

■ If an international talent search were 
to select the top 10 percent of all 
students in the 41 TIMSS countries, 
in mathematics 5 percent of U.S. 
students would be included. In sci- 
ence 13 percent would be included. 




ACHIEVEMENT 

One of our national goals is to be “first 
in the world in mathematics and sci- 
ence achievement by the year 2000,” 
as President Bush and 50 governors 
declared in 1989. Although we are 
far from this mark, we are on a par 
with other major industrialized na- 
tions like Canada, England, and Ger- 
many. 

■ In mathematics, U.S. eighth grad- 
ers score below the international av- 
erage of the 41 TIMSS countries. 
Our students’ scores are not signifi- 
cantly different from those of En- 
gland and Germany. 



CURRICULUM 

U.S. policy makers are concerned 
about whether expectations for our 
students are high enough, and in 
particular whether they are as chal- 
lenging as those of our foreign eco- 
nomic partners. In all countries, the 
relationship between standards, 
teaching, and learning is complex. 
This is even more true in the U.S., 
which is atypical among TIMSS coun- 
tries in its lack of a nationally defined 
curriculum. 




■ The content taught in U.S. eighth- 
grade mathematics classrooms is 
at a seventh-grade level in com- 
parison to other countries. 

■ Topic coverage in U.S. eighth- 
grade mathematics classes is not 
as focused as in Germany and 
Japan. 

■ In science, the degree of topic focus in 
the U.S. eighth-grade curriculum may 
be similar to that of other countries. 

■ U.S. eighth graders spend more 
hours per year in math and science 
classes than German and Japanese 
students. 



■ U.S. mathematics teachers’ typi- 
cal goal is to teach students how 
to do something, while Japanese 
teachers’ goal is to help them un- 
derstand mathematical concepts. 

■ Japanese teachers widely practice 
what the U.S. mathematics reform 
recommends, while U.S. teachers do 
so infrequently 

■ Although most U.S. math teachers 
report familiarity with reform rec- 
ommendations, only a few apply the 
key points in their classrooms. 

TEACHERS' LIVES 




TEACHING 

In recent years, concern about the qual- 
ity of instruction in U.S. classrooms 
has led mathematics professional orga- 
nizations to issue calls for reform. How- 
ever, TIMSS data cannot tell us about 
the success of these reform efforts for 
several reasons, including the fact that 
this assessment occurred too soon af- 
ter the beginning of the reform for 
states and districts to have designed 
their own programs, retrained teach- 
ers,. and nurtured a generation of stu- 
dents according to the new approach. 
Also, we do not have comparable ear- 
lier baseline information against which 
to compare the findings from TIMSS. 
However, TIMSS includes the first large- 
scale observational study of U.S. teach- 
ing ever undertaken, and this can form 
a baseline against which future progress 
may be judged. 

■ U.S. mathematics classes require stu- 
dents to engage in less high-level 
mathematical thought than classes 
in Germany and Japan. 



The training that teachers receive be- 
fore they enter the profession and the 
regular opportunities that they have for 
on-the-job learning and improvement 
of their teaching affect the quality of 
the teaching force. The collegial sup- 
port that teachers receive and the char- 
acteristics of their daily lives also af- 
fect the type of teaching they provide. 

■ Unlike new U.S. teachers, new Japa- 
nese and German teachers undergo 
long-term structured apprentice- 
ships in their profession. 

■ U.S. teachers have more college edu- 
cation than their colleagues in all but 
a few TIMSS countries. 

■ Japanese teachers have more oppor- 
tunities to discuss teaching-related 
issues than do U.S. teachers. 

■ Student diversity and poor disci- 
pline are challenges not only for U.S. 
teachers, but for German teachers 
as well. 
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STUDENTS' LIVES 



CONCLUSIONS 



The manner in which societies structure 
the schooling process gives rise to differ- 
ent opportunities and expectations for 
young people. The motivators, supports, 
and Obstacles to study in each country 
are outgrowths of the choices provided 
by society and schools. 

■ Eighth-grade students of different 
abilities are typically divided into dif- 
ferent classrooms in the U.S., and 
into different schools in Germany 
In Japan, no ability grouping is prac- 
ticed at this grade level. 

■ In mathematics, U.S. students in 
higher ability-level classes study dif- 
ferent material than students in 
lower-level classes. In Germany and 
Japan, all students study basically the 
same material, although in Germany 
the depth and rigor of study depends 
on whether the school is for students 
of higher or lower ability levels. 

■ Japanese eighth-graders are prepar- 
ing for a high-stakes examination to 
enter high school at the end of ninth 
grade. 

■ U.S. teachers assign more homework 
and spend more class time discuss- 
ing it than teachers in Germany and 
Japan. U.S. students report about 
the same amount of out-of-school 
math and science study as their Japa- 
nese and German counterparts. 

■ Heavy TV watching is as common 
among U.S. eighth graders as it is 
among their Japanese counterparts. 



This report presents initial findings from 
TIMSS for eighth-grade mathematics 
and science. A fuller understanding of 
our nation’s educational health must 
await data from the fourth and twelfth- 
grade levels. The search for factors as- 
sociated with student performance is 
complicated because student achieve- 
ment after eight years of schooling is the 
product of many different factors. Fur- 
thermore, the U.S. education system is 
large and decentralized with many in- 
terrelated parts. No single factor in iso- 
lation from others should be regarded 
as the answer to improving the perfor- 
mance of U.S. eighth-grade students. 
With these cautions in mind, this report 
offers the following insights into factors 
that may be associated with our stu- 
dents’ performance: 

■ The content of U.S. eighth-grade 
mathematics classes is not as chal- 
lenging as that of other countries, 
and topic coverage is not as focused. 

■ Most U.S. mathematics teachers re- 
port familiarity with reform recom- 
mendations, only a few apply the key 
points in their classrooms. 

■ Evidence suggests that U.S. teach- 
ers do not receive as much practical 
training and daily support as their 
German and Japanese colleagues. 

TIMSS is not an answer book, but a 
mirror through which we can see our 
own education system in international 
perspective. Careful study of our 
nation’s reflection in the mirror of in- 
ternational comparisons will assist 
educators, business leaders, teach- 
ers, and parents as they guide our 
nation in the pursuit of excellence. 
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PREFACE 



KEY POINTS: 



TheThird Internationa! Mathematics and 
Science Study (TIMSS) is the largest, most 
comprehensive, and most rigorous international 
comparison of education ever undertaken. 



TIMSS* rich information allows us not only to 
compare achievement, but also to understand 
how life in U.S. schools differs from that in other 
nations. 



This report on eighth-grade students is the first 
of a series of reports that will present findings 
on student achievement at the fourth grade, at 
the end of high school, as well as on various 
other topics. 



OVERVIEW 



The Third International Mathematics 
and Science Study is the largest and 
most comprehensive comparative in- 
ternational study of education that 
has ever been undertaken. A half- 
million students from 41 countries 
were tested in 30 different languages 
at five different grade levels to com- 
pare their mathematics and science 
achievement. Intensive studies of 
students, teachers, schools, curricu- 
lum, instruction, and policy issues 
were also carried out to understand 
the educational context in which 



for reform in the teaching of their sub- 
jects. The National Council of Teachers 
of Mathematics published Curriculum 
and Evaluation Standards in 1989, and 
Professional Standards for Teaching Math- 
ematics in 1 99 1 . Ini 993 the American 
Association for the Advancement of Sci- 
ence followed suit with Benchmarks for 
Science Literacy, and in 1 996, the National 
Academy of Sciences published National 
Science Education Standards. 

TIMSS helps us measure progress to- 
ward our national goal of improving our 
children’s academic performance in 
mathematics and science. But TIMSS 



learning takes place. 



TIMSS COUNTRIES 



AUSTRALIA 


KOREA 


AUSTRIA . 


KUWAIT 


BELGIUM (FLEMISH) 


LATVIA 


BELGIUM (FRENCH) 


LITHUANIA 


BULGARIA 


NETHERLANDS 


CANADA 


NEW ZEALAND 


COLOMBIA 


NORWAY 


CYPRUS 


PORTUGAL 


CZECH REPUBLIC 


ROMANIA 


DENMARK 


RUSSIAN FEDERATION 


ENGLAND 


SCOTLAND 


FRANCE 


SINGAPORE 


GERMANY 


SLOVAK REPUBLIC 


GREECE 


SLOVENIA 


HONC KONG 


SOUTH AFRICA 


HUNGARY 


SPAIN 


ICELAND 


SWEDEN 


IRAN, ISLAMIC REPUBLIC 


SWITZERLAND 


IRELAND 


THAILAND 


ISRAEL 


UNITED STATES 



JAPAN 



TIMSS is an important study for those 
interested in U.S. education. In 1983, 
the National Commission on Excellence 
in Education pointed to our nation’s low 
performance in international studies as 
evidence that we were A Nation at Risk. 
In 1989, President Bush and the gover- 
nors of all 50 states adopted the Na- 
tional Goals for Education, one of which 
was that “by the year 2000, the U.S. will 
be first in the world in mathematics and 
science achievement.” Mathematics and 
science experts have issued major calls 



is much more than a scorecard for the 
math and science events in the “edu- 
cational Olympics.” It is a diagnostic 
tool to help us examine our nation’s 
progress toward improvement of math- 
ematics and science education. It was 
designed to look behind the scorecard 
to illuminate how our education poli- 
cies and practices compare to those of 
the world community 

TIMSS helps us answer the following 
questions about our nation s mathemat- 
ics and science learning: 

■ Are U.S. curricula and expectations 
for student learning as demanding 
as those of other nations? 

■ Is the level of classroom instruction 
in the U.S. as high as that in other 
countries? 

■ Do U.S. teachers receive as much 
support in their efforts to teach stu- 
dents as their colleagues in other 
nations? 

■ Are U.S. students as focused on their 
studies as their international coun- 
terparts? 
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This report draws from the many reports 
and parts of the TIMSS study to summa- 
rize the initial findings concerning achieve- 
ment and schooling in the eighth grade. 
It is part of the first of three waves of 
TIMSS reports. It will be followed in the 
next year by a series of reports focusing 
on the fourth grade, then by a series fo- 
cusing on the last year of high school. 
Additional reports on selected topics will 
be published over the next several years. 
Much more will be learned as further 
analysis of the eighth grade data is car- 
ried out and findings from grades four and 
twelve are added. 

TIMSS is a fair and accurate compari- 
son of mathematics and science 
achievement in the participating na- 
tions. It is not a comparison of “all of 
our students, with other nations’ best,” 
a charge which some critics have lev- 
eled at previous international compari- 
sons. The students who participated 
in TIMSS were randomly selected to 
represent all students in their respec- 
tive nations. The entire assessment 
process was scrutinized by international 
technical review committees to ensure 
its adherence to established standards. 
Those nations in which irregularities 
arose are clearly noted in this and other 
TIMSS reports. 

At each step of its development, TIMSS 
used careful quality control procedures. 
An international curriculum analysis was 
carried out prior to the development of 
the assessments to ensure that the tests 
reflect the math and science curricula 
of the variety of TIMSS countries and 
do not over-emphasize what is taught 
in only a few. International monitors 
carefully checked the test translations 
and visited many classrooms while the 
tests were being administered in each of 



the 41 countries to make sure that the 
instructions were properly followed. The 
raw data from each country were scruti- 
nized to be sure that no anomalies ex- 
isted, and all analyses were double 
checked. Finally, this report has been 
written and carefully reviewed to avoid 
over-generalization and inaccuracy 



STUDY DESIGN 

TIMSS is the third comparison of 
mathematics and science achievement 
carried out by the International Asso- 
ciation for the Evaluation of Educa- 
tional Achievement (IEA). Previous 
IEA studies of mathematics and sci- 
ence were conducted for each subject 
separately at various times during the 
1960s, 1970s, and 1980s. This is the 
first time that IEA has assessed both 
mathematics and science in the same 
study. Comparative studies of other 
subjects, including reading literacy 
(1992) 1 , and computers in education 
( 1 993) 2 have also been published by the 
IEA. 

TIMSS was designed to focus on stu- 
dents at three different stages of school- 
ing: midway through elementary school, 
midway through lower secondary school, 
and at the end of upper secondary 
school. Because countries around the 
world set different ages at which chil- 
dren should begin school, decisions 
about which students should be tested 
needed to take both age and grade level 
into account. The populations tested 
are listed below. Participation in Popu- 
lation 2 was required of all TIMSS na- 
tions, but participation in Populations 
1 and 3 was optional. 
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■ Population 1 - those students enrolled 
in the pair of adjacent grades that 
contained the most nine-year-olds. 
(Grades 3 and 4 in the U.S. and most 
of the world. Grades 2 and 3 in a 
few nations.) 

■ Population 2 - those students in the 
pair of adjacent grades that con- 
tained the most thirteen-year-olds 
at the time of testing. (Grades 7 and 
8 in the U.S. and most of the world. 
Grades 6 and 7 in a few nations.) 

■ Population 3 - students in their fi- 
nal year of secondary school, what- 
ever their age. (Grade 12 in the U.S. 
and most nations. Grades 9-13 in 
some nations.) 

In all countries, students in both public 
and private schools received the TIMSS 
test. In all but a few of the 4 1 TIMSS 
countries, virtually all population I and 
2 children are enrolled in school and 
were therefore eligible to take the test. 
Testing occurred 2 to 3 months before 
the end of the 1 995 -96 school year. Stu- 
dents with special needs and disabilities 
which would make it difficult for them 
to take the test were excused from the 
assessment. In each country, the test 
was translated into the primary language 
or languages of instruction. All testing 
in the U.S. was done in the English lan- 
guage. 

TIMSS includes five different parts: as- 
sessments, questionnaires, curriculum 
analyses, videotapes of classroom in- 
struction, and case studies of policy top- 
ics. The study was designed to bring a 
variety of different and complementary 
research methods to bear on important 
policy questions. The use of multiple 
methodologies has three major benefits. 
First, it strengthens the conclusions of 
the study because researchers are able 
to cross-check key findings by compar- 



ing results based on different research 
methods. Second, it provides broader 
information because more different 
types data are gathered than can be ac- 
quired through a single method or in- 
strument. Third, the use of multiple 
methodologies enriches understanding 
of the contextual meaning of key find- 
ings. Each of the five parts on its own 
represents an important advance in its 
field. Taken together, they provide an 
unprecedented opportunity to under- 
stand U.S. mathematics and science edu- 
cation from a new and richer perspec- 
tive. 

At population 2, all 41 TIMSS coun- 
tries participated in the following three 
IEA-sponsored parts of the study: 

■ Math and science assessments - One 
and a half hours in length, the as- 
sessments included both multiple- 
choice and free-response items. A 
smaller number of students also 
completed “hands-on” performance 
assessments, to be reported later. 

■ School, teacher, and student ques- 
tionnaires - Students answered 
questions about their mathematics 
and science studies and beliefs. 
Teachers answered questions on 
their beliefs about math and sci- 
ence and on teaching practices. 
School administrators answered 
questions about school policies 
and practices. 

■ Curriculum analysis - This ex- 
ploratory study compared math- 
ematics and science curriculum 
guides and textbooks. It studied 
subject-matter content, sequenc- 
ing of topics, and expectations for 
student performance. 





«v 



In conjunction with these three activi- 
ties, the United States sponsored two 
additional parts of TIMSS, which were 
carried out in Germany, Japan, and the 
U.S. These three countries are all eco- 
nomic superpowers with close eco- 
nomic and political ties. They also are 
nations whose educators have learned 
a great deal from each other in the past, 
and whose school' systems are both simi- 
lar to and different from each other in 
important ways. The TIMSS research- 
ers in Germany, Japan, and U.S. collabo- 
rated in sharing their assessment and 
questionnaire data, and in carrying out 
the following two parts of the study: 

■ Videotapes of mathematics instruc- 
tion - In the U.S. and Germany, half 
of the eighth-grade mathematics 
classrooms that participated in the 
main TIMSS study were randomly 
chosen to be filmed. In Japan, an 
eighth-grade classroom in a random 
sample of 50 of the TIMSS schools 
was chosen to be videotaped. In all 
three countries teachers were filmed 
teaching a typical lesson, and these 
tapes were analyzed to compare 
teaching techniques and the quality 
of instruction. 

■ Ethnographic case studies of key 
policy topics - A team of 12 bilin- 
gual researchers each spent three 
months in Germany, Japan, or the 
U.S. observing classrooms and inter- 
viewing education authorities, prin- 
cipals, teachers, students, and par- 
ents. Topics of study were education 
standards, methods of dealing with 
individual differences, the lives and 
working conditions of teachers, and 
the role of school in adolescents’ lives. 

More detail on the findings and meth- 
odology of each of these parts of TIMSS 



can be found in the additional reports 
listed in Appendix 1 . 



THE TIMSS RESEARCH TEAM 

TIMSS was conducted by the IEA, 
which is a Netherlands-based organi- 
zation of ministries of education and 
research institutions in its member 
countries. The IEA delegated respon- 
sibility for overall coordination and 
management of the TIMSS study to 
Professor Albert Beaton at the TIMSS 
International Study Center, located at 
Boston College. Each of the 41 IEA 
member-nations that made the deci- 
sion to participate in TIMSS paid for 
and carried out the data collection in 
its own country according to the in- 
ternational guidelines. The costs of the 
international coordination were paid 
by the National Center for Education 
Statistics of the U.S. Department of 
Education (NCES), the National Sci- 
ence Foundation (NSF), and the Cana- 
dian Government. 

TIMSS in the United States was also 
funded by NCES and NSE Professor 
William Schmidt of Michigan State Uni- 
versity was the U.S. National Research 
Coordinator. Policy decisions on the 
study were made by the U.S. National 
Coordinating Committee, composed of 
William Schmidt, Larry Suter of NSF, 
and Jeanne Griffith, Eugene Owen, and 
Lois Peak of NCES. Lois Peak moni- 
tored the international and U.S. TIMSS 
data collections. The U.S. data collec- 
tion was carried out by Westat, a pri- 
vate survey research firm. Trevor Will- 
iams and Nancy Caldwell were Westat 
project co-directors. Professor James 
Stigler at UCLA managed the TIMSS 
videotape study of mathematics instruc- 



tion, and Professor Harold Stevenson at 
the University of Michigan managed the 
TIMSS ethnographic case studies. The 
many advisors to the study are listed in 
Appendix 2. 

The U.S. TIMSS team also includes the 
nearly 4,000 seventh and 7,000 eighth 
graders who took the assessment, and 
their principals and teachers in more 
than 1 80 schools nationwide. Their co- 
operation has made this report possible. 
Third, fourth, and twelfth graders also 
took different TIMSS tests, and find- 
ings from these parts of the study will 
be reported during the next year. 



ORGANIZATION OF THIS REPORT 

This report summarizes early findings 
from the eighth-grade data based on 
results from all five parts of the TIMSS 
study Both seventh and eighth grade 
students took the TIMSS test, but this 
initial report focuses on findings for 
the eighth grade. Future reports based 
on a more complete and extensive 
analysis of the data will provide deeper 
understanding and investigate relation- 
ships between the findings from the 
different parts of the study Science 
teacher questionnaire data used in this 
report are based on preliminary weights 
which will be further refined in subse- 
quent reports. Extensive documentation 
of the data collection methodologies and 
statistical analyses used in this report are 
available from NCES, and will be pub- 
lished separately 

This report combines the major find- 
ings from each of the five parts of the 
study into a single story about U.S. 
eighth-grade mathematics and science 
achievement in comparative perspective. 



In some respects, results for mathemat- 
ics and science are similar. The report 
focuses more on mathematics for two 
reasons. First, the way in which the sub- 
ject is taught makes it easier to compare 
across countries. Second, TIMSS con- 
tains more data about mathematics be- 
cause the videotapes of classroom in- 
struction were conducted only in this 
subject. Discussion of findings notes 
where the results in science differ 
from those in math. This report de- 
scribes the U.S. against the backdrop 
of the 41 TIMSS countries, with a spe- 
cial attention to comparisons with 
Germany and Japan, because we 
have more information on these 
countries. 

Chapter 1 draws from the results of 
the student assessments to describe how 
U.S. students perform in mathematics 
and science. Succeeding chapters fo- 
cus on factors which may have an im- 
portant influence on achievement, and 
describe how our nation’s schools, 
teachers, and students compare to those 
in other countries. Chapter 2 exam- 
ines educational standards and the cur- 
riculum, based on data from the cur- 
riculum analysis, case studies, video- 
tape study, and questionnaires. 
Chapter 3 focuses on how teachers 
actually teach that curriculum, drawing 
from results of the videotape study and 
questionnaires. Chapter 4 examines the 
working life of teachers, based upon 
findings from the case studies and ques- 
tionnaires. Chapter 5 describes the lives 
of students, both in and out of school, 
based upon case study and questionnaire 
data. The Conclusions at the end of the 
report looks across all of the findings for 
insights about factors associated with 
student performance and indicates ques- 
tions for further study 
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CHAPTER 1 : 
ACHIEVEMENT 



KEY POINTS: 



U.S. eighth graders score below average in 
mathematics achievement and above average in 
science achievement, compared to the 41 
nations in theTIMSS assessment. 



In mathematics, our eighth-grade students’ 
international standing is stronger in Algebra and 
Fractions than in Geometry and Measurement. 



In science, our eighth graders’ international 
standing is stronger in Earth Science, Life 
Science, and Environmental Issues than in 
Chemistry and Physics. 

The U.S. is one of I I TIMSS nations in which 
there is no significant gender gap in eighth- 
grade math and science achievement. 
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In the past, the mathematics and science 
achievement of U.S. students has caused 
nation-wide cries for improvement. Vari- 
ous international studies of these sub- 
jects conducted over the past thirty years 
have shown that our eighth graders have 
not performed as well as we expect, in 
comparison to their peers in other na- 
tions. U.S. students are not weak in all 
subjects, however. In a recent IEA study 
of reading literacy 3 , U.S. eighth graders 
were among the best in the world. In- 
deed, TIMSS shows that U.S. eighth 
grade students also scored better than 
the average of the 4 1 participating coun- 
tries in science. The results in math- 
ematics, however, put our nation below 
average compared to the other nations. 



HOW WELL DO U.S. STUDENTS 
DO? 

Compared to their international coun- 
terparts, U.S. students are somewhat 
below the international average of 41 
TIMSS countries in mathematics. In 
science, our students are somewhat 
above the international average. Fig- 
ures 1 and 2 on pages 20 and 2 1 show 
how U.S. students perform in these sub- 
jects. 

Tempting as it may be, it is not correct to 
report U.S. scores by rank alone, as 

would be the case if one were to say 
the U.S. is “number x in mathemat- 
ics out of the 41 TIMSS countries.” 
This is because the process of esti- 
mating each country’s score from the 
sample of students who took the test 
produces only an estimate of the 
range within which the country’s real 
score lies. This margin of error is ex- 
pressed as a “plus or minus” interval 
around the estimated score. In TIMSS, 
we can say with 95 percent confi- 



dence that comparisons of other coun- 
tries to the U.S. are accurate plus or 
minus about 20 points, depending on 
the size and design of the sample in the 
other countries. Comparisons of the 
U.S. to the international average are 
accurate plus or minus about 1 0 points. 
(Appendix 3 contains a list of standard 
errors). Because the precise score can- 
not be determined with perfect accuracy, 
to fairly compare the U.S. to other coun- 
tries, nations have been grouped into 
broad bands according to whether 
their performance is higher than, not 
significantly different from, or lower 
than the U.S. 

In mathematics, students in 20 coun- 
tries outperform our eighth graders. 
Students in 13 countries are not sig- 
nificantly different than ours, and U.S. 
students outperform their counterparts 
in 7 nations. In science, students in 9 
nations outperform U.S. eighth grad- 
ers, performance in 1 6 other nations is 
not statistically different than ours, and 
we outperform another 15 nations. 



SOME SPECIAL NOTES ON THE 
TEST SCORES 

TIMSS required participating nations to 
adhere to extremely high technical stan- 
dards at all stages of participation in 
the project. Many nations experienced 
some difficulty in this respect. In two 
nations, difficulties in meeting the stan- 
dards were so severe that international 
monitors decided that their data should 
not be included in the report, and so 
findings are reported only for the remain- 
ing 41 nations. Of the 41 nations, 25 
met or came close to meeting all tech- 
nical standards for the study. However, 
16 nations experienced difficulties of 
various types. In some countries, these 



FIGURE 1: 

Nations' Average Mathematics Performance Compared to the U.S. 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY HIGHER THAN THE U.S. 


NATION 


AVERAGE 


SINGAPORE 


643 


KOREA 


607 


JAPAN 


605 


HONG KONG 


588 


BELGIUM-FLEMISH 0 


565 


CZECH REPUBLIC 


564 


SLOVAK REPUBLIC 


547 


SWITZERLAND 0 


545 


(NETHERLANDS) 


541 


(SLOVENIA) 


541 


(BULGARIA) 


540 


(AUSTRIA) 


539 


FRANCE 


538 


HUNGARY 


537 


RUSSIAN FEDERATION 


535 


(AUSTRALIA) 


530 


IRELAND 


527 


CANADA 


527 


(BELGIUM-FRENCH) 


526 


SWEDEN 


519 



International Average = 513 



SOURCE: Beaton et al.{!996) Alothemoto ochievement 
in the middle school years. Table I . I . Boston College: Chest- 
nut Hill, MA. 



NATIONS WITH AVERAGE SCORES 
NOT SIGNIFICANTLY DIFFERENT 
FROM THE U.S. 


NATION 


AVERAGE 


(THAILAND) 


522 


(ISRAEL) * 


522 


(GERMANY) *° 


509 


NEW ZEALAND 


508 


ENGLAND *° 


506 


NORWAY 


503 


(DENMARK) 


502 


UNITED STATES ° 


500 


(SCOTLAND) 


498 


LATVIA (LSS) ° 


493 


SPAIN 


487 


ICELAND 


487 


(GREECE) 


484 


| (ROMANIA) 


482 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY LOWER THAN THE U.S. 


NATION 


AVERAGE 


LITHUANIA * 


477 


CYPRUS 


474 


PORTUGAL 


454 


IRAN, ISLAMIC REPUBLIC 


428 


(KUWAIT) 


392 


(COLOMBIA) 


385 


(SOUTH AFRICA) 


354 



NOTES: 

1. Nations not meeting international guidelines are shown in parentheses. 

2. Nations in which more than 10 percent of the population was excluded from testing are shown with a *. Latvia is 
designated LSS because only Latvian-speaking schools were tested, which represents less than 65 percent of the 
population. 

3. Nations in which a participation rate of 75 percent of the schools and students combined was achieved only after 
replacements for refusals were substituted, are shown with a 

A. The international average is the average of the national averages of the 4 1 nations. 

5. The country average for Sweden may appear to be out of place; however, statistically, its placement is correct. 




difficulties arose because a large propor- 
tion of schools, teachers, or students de- 
clined to take the test. In others, the 
selection of schools or classrooms was 
not carried out according to interna- 
tional plan. In still others, students were 



slightly older than the international tar- 
get age. The names of those nations in 
which major difficulties arose are shown 
in parentheses in the figures in this re- 
port, and Appendix 4 describes any de- 
viations from international specifica- 
(con tinned on page 23 ) 
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FIGURE 2: 

Nations' Average Science Performance Compared to the U.S. 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY HIGHER THAN THE U.S. 


NATION 


AVERAGE 


SINGAPORE 


607 


CZECH REPUBLIC 


574 


JAPAN 


571 


KOREA 


565 


(BULGARIA) 


565 


(NETHERLANDS) 


560 


(SLOVENIA) 


560 


(AUSTRIA) 


558 


HUNGARY 


554 



NATIONS WITH AVERAGE SCORES 
NOT SIGNIFICANTLY DIFFERENT 
FROM THE U.S. 


NATION 


AVERAGE 


ENGLAND *° 


552 


BELGIUM-FLEMISH 0 


550 


(AUSTRALIA) 


545 


SLOVAK REPUBLIC 


544 


RUSSIAN FEDERATION 


538 


IRELAND 


538 


SWEDEN 


535 


UNITED STATES ° 


534 


(GERMANY) *° 


531 


CANADA 


531 


NORWAY 


527 


NEW ZEALAND 


525 


(THAILAND) 


525 


(ISRAEL) * 


524 


HONG KONG 


522 


SWITZERLAND 0 


522 


(SCOTLAND) 


517 



NATIONS WITH AVERAGE SCORES 
SIGNIFICANTLY LOWER THAN THE U.S. 


NATION 


AVERAGE 


SPAIN 


517 


FRANCE 


498 


(GREECE) 


497 


ICELAND 


494 


(ROMANIA) 


486 


LATVIA (LSS) ° 


485 


PORTUGAL 


480 


(DENMARK) 


478 


LITHUANIA * 


476 


(BELGIUM-FRENCH) 


471 


IRAN, ISLAMIC REPUBLIC 


470 


CYPRUS 


463 


(KUWAIT) 


430 


(COLOMBIA) 


411 


(SOUTH AFRICA) 


326 



International Average = 516 



SOURCE: Beaton et al. (1996) Science achievement in 

the middle school years. Table LI. Boston College: Chest- 
nut Hill, MA. 

NOTES: 

1. Nations not meeting international guidelines are shown 
in parentheses. 

2. Nations in which more than 10 percent of the popu- 
lation was excluded from testing are shown with a *. 
Latvia is designated LSS because only Latvian-speaking 
schools were tested, which represents less than 65 
percent of the population. 

3. Nations in which a participation rate of 75 percent of 
the schools and students combined was achieved only 
after replacements for refusals were substituted, are 
shown with a °. 

4. The international average is the average of the national 
averages of the 4 1 nations. 

5. The country average for Scotland (or Spain) may ap- 
pear to be out of place; however, statistically, its place- 
ment is correct. 
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FIGURE 3: 

Average Achievement of Nations Meeting, 
and Not Meeting, International Guidelines 



COUNTRIES COMPLYING 
WITH SPECIFICATIONS 


Nation 


Math 


Science 


AVERAGE AVERAGE 


BELGIUM-FLEMISH 0 


565 


550 


CANADA 


527 


531 


CYPRUS 


474 


463 


CZECH REPUBLIC 


564 


574 


ENGLAND *° 


506 


552 


FRANCE 


538 


498 


HONG KONG 


588 


522 


HUNGARY 


537 


554 


ICELAND 


487 


494 


IRAN, ISLAMIC REPUBLIC 


428 


470 


IRELAND 


527 


538 


JAPAN 


605 


571 


KOREA 


607 


565 


LATVIA f LSS) 0 


493 


485 


LITHUANIA * 


477 


476 


NEW ZEALAND 


508 


525 


NORWAY 


503 


527 


PORTUGAL 


454 


480 


RUSSIAN FEDERATION 


535 


538 


SINGAPORE 


643 


607 


SLOVAK REPUBLIC 


547 


544 


SPAIN 


487 


517 


SWEDEN 


519 


535 


SWITZERLAND ° 


545 


522 


UNITED STATES 0 


500 


534 


INTERNATIONAL 






AVERAGE = 


527 


527 



Notes: 

1 . Nations in which more than 1 0 percent of the popula- 
tion was excluded from testing are shown with a *. Latvia 
is designated LSS because only Latvian-speaking schools 
were tested, which represents less than 65 percent of 
the population. 

2. Nations in which a participation rate of 75 percent of 
the schools and students combined was achieved only 
after replacements for refusals were substituted, are 
shown with a °. 

3. The international average is 527 for both mathematics 
and science. This is the average of the national averages of 
the 25 countries meeting international guidelines. 

4. The international average based on all 4 1 countries listed 
is 5 1 3 for mathematics and 5 1 6 for science. 



COUNTRIES WITH LOW 
PARTICIPATION RATES 


Nation 


Math Science 




AVERAGE AVERAGE 


AUSTRALIA 


530 


545 


AUSTRIA 


539 


558 


BELGIUM-FRENCH 


526 


471 


BULGARIA 


540 


565 


NETHERLANDS 


541 


560 


SCOTLAND 


498 


517 



COUNTRIES TESTING 


OLDER-THAN-SPECIFIED STUDENTS 


Nation 


Math 


Science 




AVERAGE 


AVERAGE 


COLOMBIA 


385 


411 


GERMANY 


509 


531 


ROMANIA 


482 


486 


SLOVENIA 


541 


560 



COUNTRIES WITH NON-STANDARD 
SELECTION OF CLASSROOMS 


Nation 


Math 


Science 




AVERAGE 


AVERAGE 


DENMARK 


502 


478 


GREECE 


484 


497 


THAILAND 


522 


525 



COUNTRIES WITH NON-STANDARD 
SELECTION OF CLASSROOMS AND 
OTHER DEPARTURES FROM GUIDELINES 



Nation 


Math 


Science 




AVERAGE 


AVERAGE 


ISRAEL 


522 


524 


KUWAIT 


392 


430 


SOUTH AFRICA 


354 


326 



Source: Beaton et al. (1996) Mathematics achievement 
in the middle school years. Table I . I . Boston College: Chest- 
nut Hill, MA.,and Beaton et al. ( 1 996) Science achievement 
in the middle school years. Table I . I . Boston College: Chest- 
nut Hill, MA. 



tions that occurred. It should be kept 
in mind that we cannot have the same 
amount of confidence in the scores of 
the 16 nations in which major difficul- 
ties arose. 

If the international average is calcu- 
lated only from the 25 countries in 
which no major difficulties arose in 
carrying out the international speci- 
fications, the U.S. mathematics 
score is still below the international 
average. In science, however, our 
score is no longer significantly dif- 
ferent from the average of the 25 na- 
tions. Our comparative position in 
science becomes lower because many 
of the countries who are removed from 
consideration are those that we out- 
performed. Figure 3 on page 22 shows 
our mathematics and science standing 
in comparison to these 25 nations, and 
the types of anomalies that occurred in 
the other 16 countries. The difference 
in U.S. standing between Figure 3 and 
the previous figures demonstrates that 
the selection of countries against which 
the U.S. is compared can change our in- 
ternational standing. 

Which comparison should we empha- 
size as TIMSS’ main finding - the com- 
parison to 25 countries, or to 41? 
NCES has chosen as the primary find- 
ing our standing with respect to 41 
countries because the international 
TIMSS reports present the results in 
terms of all 4 1 nations. 



What do the test scores mean? Due to 
the complex nature of the TIMSS test 
design, scoring, and analysis, a score of 
600 does not mean either 600 items, or 
60 percent correct. One can interpret 
the scores by considering where they fall 
along the range of scores from 0 to 1000 
of other eighth-grade students who took 
the test. In mathematics, a score of 656 
would put a student in the top 10 per- 
cent of all students in the 41 TIMSS 
countries, and a score of 587 would put 
a student in the top 25 percent. In math- 
ematics, 509 was the average student 
score. In science, a score of 655 would 
put a student in the top 10 percent, a 
score of 592 would put a student in the 
top 25 percent, and 522 was the aver- 
age student score. 



WHICH COUNTRIES 
OUTPERFORM THE U.S. IN BOTH 
SUBJECTS? 

We can say with confidence that five 
nations outperformed us in both math- 
ematics and science. They are: 

■ Three Asian nations - Singapore, 
Korea, and Japan. 

■ Two Central European nations - 
Czech Republic and Hungary. 

The Netherlands, Austria, Slovenia, and 
Bulgaria also outperformed us in both 
subjects, but because these countries 
did not carry out TIMSS according to 
strict international standards, we can 
be less certain about their scores. 
These nine countries were the only ones 
that outperformed us in science, and 
they were also among the 20 countries 
that outperformed us in mathematics. 

















WHICH COUNTRIES DOES THE U.S. 
OUTPERFORM IN BOTH SUBJECTS? 

We can say with confidence that the 
U.S. outperformed four countries in 
both mathematics and science: 

■ Three European countries 
Lithuania, Cyprus, and Portugal. 

■ One Middle Eastern country - Iran. 

The U.S. also outperformed Kuwait, Co- 
lombia, and South Africa in both sub- 
jects, but due to deviations in their ad- 
ministration of TIMSS, we have less 
confidence in their scores. These seven 
countries were the only ones that we 
outperformed in mathematics, and 
they were also among the 15 countries 
that we outperformed in science. 

HOW DO WE COMPARE TO OUR 
MAJOR ECONOMIC PARTNERS? 

The “Group of Seven” or G-7 countries 
are major U.S. economic and political 
allies. The other six nations in this group 
are the United Kingdom, France, Ger- 
many, Canada, Japan, and Italy Italy 
did not administer the TIMSS test, so 
the U.S. can only be compared to the 
remaining Five. The United Kingdom 
includes England, Scotland, Northern 
Ireland, and Wales. Northern Ireland 
and Wales did not participate in TIMSS, 
and England and Scotland both have the 
same international standing in compari- 
son to the U.S. Therefore, in this sec- 
tion, we describe our standing in rela- 
tion to England. 

In mathematics, Japan, France, and 
Canada outperform the U.S., while our 
scores are not significantly different from 



those of England and Germany In sci- 
ence, we score lower than Japan; were 
not significantly different than England, 
Canada, and Germany; and score higher 
than France. Considering our stand- 
ing in relation to these five major eco- 
nomic partners, it can be said that the 
U.S. is in the bottom half in math- 
ematics, and about the middle in sci- 
ence. 

Among the G-7 countries, Germany is 
the only nation which appears in pa- 
rentheses, indicating problems in the 
implementation of the international 
guidelines for carrying out the study 
In Germany, the problem was a discrep- 
ancy in the age of the students tested. 
Because German children start school 
somewhat later than children in other 
countries, the average age of the Ger- 
man eighth-graders who took the 
TIMSS test was about four months 
older than the international target age. 
Some would say that this means that 
other nations’ eighth graders should be 
compared with Germany’s seventh grad- 
ers for a better age comparison. How- 
ever, this provides a less-than-ideal grade 
comparison. 

In a grade-based comparison, there 
is no significant difference between 
German and U.S. eighth graders. If 
we were to approximate an age-based 
comparison by matching the scores 
of our eighth graders to those of Ger- 
man seventh graders, our eighth 
graders do significantly better. Both 
comparisons are useful because most 
experts believe that achievement is 
based partly on cognitive maturation 
which comes with age, and partly on 
years of study which come with grade 
in school. 



HOW FAR BEHIND THE TOP 
COUNTRIES ARE WE? 

Particularly in mathematics, our stu- 
dents are far behind Singapore and 
Japan which are among the top-scor- 
ing nations in the world in both math 
and science. One way to compare two 
nations’ scores is by considering their 
comparative standing with relation to 
the international percentiles. In math- 
ematics, the scores of our very best U,S, 
eighth graders, who perform at the 95 th 
percentile for our nation, are not signifi- 
cantly different than the scores of aver- 
age eighth graders in Singapore, who per- 
form at their nation’s 50 th percentile. In 
comparison to Japan, the scores of our 
best students, who are at the 95 th per- 
centile for our nation, are significantly 
below the scores of the top quarter of 
Japanese students, who perform at their 
nation’s 75 th percentile. 

In science, the gap is not so large. Stu- 
dents at the U.S. 95 th percentile are 
significantly better than students at the 
75 Ul percentile in Singapore, In com- 
parison to Japan, there is no significant 
difference between U.S, and Japanese 
students at the 95 th percentile. 

Another way to estimate distance be- 
tween the U.S. and top scoring coun- 
tries is to use the difference between our 
seventh and our eighth graders as a unit 
of measure. In mathematics, the differ- 
ence between our seventh and eighth 
graders’ scores was 24 points. The differ- 
ence between the scores of eighth grad- 
ers in the U.S. and in Singapore was 1 43 
points. This means that the difference 
in eighth-grade mathematics perfor- 
mance between the two countries is al- 
most six times the difference between U.S. 
seventh and eighth graders. The differ- 



ence between U.S. and Japanese eighth 
graders’ mathematics performance is 
about four times this difference. 

In science, the gap is smaller, but still 
substantial. The difference between U.S. 
seventh and U.S. eighth graders’ scores 
is 26 points. The difference between the 
scores of the U.S. and Singapore was 73 
points. The difference in science per- 
formance between eighth graders in the 
U.S. and Singapore is almost three times 
the difference between our seventh and 
eighth graders. The difference between 
U.S. and Japanese eighth graders’ sci- 
ence performance is almost one and a 
half times this difference. 



HOW DO OUR BEST STUDENTS 
COMPARE WITH OTHERS' BEST? 

Comparisons of averages tell us how 
typical students perform, but they do 
not tell us about the performance of 
our nation’s best students - those who 
are likely to become the next genera- 
tion of mathematicians, scientists, 
doctors, and engineers. If an interna- 
tional talent search were to select the 
top ten percent of all students in 
the 41 TIMSS countries combined, 
what percentage of U.S. students 
would be included? 

In mathematics, 5 percent of U.S. 
eighth graders would be selected. 

High -scoring nations would have more 
of their students represented in the “in- 
ternational top ten percent.” Figure 4 
on page 26 shows that 45 percent of all 
Singaporean students and 32 percent of 
all Japanese students would be chosen 
in the international talent search in 
mathematics. In science, 13 percent 
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FIGURE 4: 

Percent of Students from Selected 
Nations Scoring Among the Top 1 0 
Percent of Eighth Graders in the 41 
TIMSS Countries 



of U.S. students would be selected, in 

comparison to 31 percent of 
Singaporean students and 18 percent of 
Japanese students. 
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If the international talent search were 
to lower its standards considerably to 
choose the top half of all students in 
the 41 TIMSS countries, 94 percent of 
eighth graders in Singapore and 83 per- 
cent in Japan would be selected in 
mathematics, compared to 45 percent 
of eighth graders in the U.S. In sci- 
ence, 82 percent of the students in 
Singapore and 71 percent of students 
in Japan would be selected, compared 
to 55 percent in the U.S. 



HOW DOES THE U.S. 
MATHEMATICS AND SCIENCE 
GENDER GAP COMPARE TO 
OTHER COUNTRIES'? 
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In the U.S. and in other countries, 
policy makers have made great efforts 
to make math and science more acces- 
sible to girls, and to encourage gender 
equity in these subjects. More TIMSS 
countries have achieved gender equity 
in their students’ scores in mathemat- 
ics than in science. The U.S. is one of 
1 1 TIMSS nations in which there is 
no significant gender gap in eighth- 
grade mathematics and science 
achievement. The U.S. was one of 33 
countries in which there was no statisti- 
cally significant difference between the 
performance of eighth-grade boys and 



Source: Beaton et al. ( 1 996) Mathematics achievement 
in the middle school years. Table 1.4. Boston College: Chest- 
nut Hill, MA., and Beaton et al. ( 1 996) Science achievement 
in the middle school years. Table 1 .4. Boston College:Chest- 
nut Hill, MA. 
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girls in mathematics. In science, we were 
one of 1 1 nations with no statistically 
significant difference. All 1 1 nations 
with no significant different in science 
also demonstrated no difference in math- 
ematics. They are the United States, 
Singapore, the Russian Federation, Thai- 
land, Australia, Ireland, Romania, Flem- 
ish Belgium, Cyprus, Columbia, and 
South Africa. 



HOW DO WE SCORE IN THE 
DIFFERENT CONTENT AREAS OF 
MATHEMATICS AND SCIENCE? 

Representing student achievement in 
mathematics and science as a total 
score is a useful way to summarize 
achievement. However, mathematics 
and science contain different content 
areas, which are emphasized and se- 
quenced differendy in curricula around 
the world. Based on these national pri- 
orities, in each country, some content 
areas have been studied more than oth- 
ers at a particular grade level. 

The TIMSS eighth-grade mathematics 
test included sets of items designed to 
sample students' ability to do work in 
the following areas: 

■ Algebra (patterns, relations, expres- 
sions, equations). 

■ Da ta Represen ta tion. Ana lysis , and Prob- 
ability (representation and analysis 
of data using charts and graphs in- 
volving uncertainty and probability). 

■ Fractions and Number Sense (fractions, 
decimals, percentages, estimation and 
rounding). 



■ Geometry (visualization and proper- 
ties of geometric figures, including 
symmetry, congruence, and similar- 
ity). 

■ Measurement (units of length, weight, 
time, area, volume, and interpretation 
of measurement scales). 

■ Proportionality' (proportionality and 
ratios). 

Figure 5 on pages 28 and 29 shows that 
among these content areas, U.S. stu- 
dents* performance is at about the in- 
ternational average in Algebra; Data 
Representation, Analysis, and Prob- 
ability; and Fractions and Number 
Sense. Compared to other countries, 
we do less well in Geometry; Measure- 
ment; and Proportionality. Our weaker 
performance in these latter three topics 
may pull the overall U.S. score down to 
below average. 

In science, the TIMSS eighth-grade test 
sampled students’ ability to do work 
in the following subjects: 

■ Chemistry (classification of matter, 
chemical properties and transforma- 
tions). 

■ Earth Science (earth features, earth 
processes, and the earth in the uni- 
verse). 

■ Environmental Issues and the Nature of 
Science (environmental and resource 
issues, the nature of scientific knowl- 
edge, and the interaction of science 
and technology). 

(Continued on page 32) 
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FIGURE 5: 

National Averages in Mathematics Content Areas 
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NOTES: 

I. Nations not meeting international study guidelines are shown in parentheses. 

2 Nations in which more than 10 percent of the population was excluded from testing are shown with a *. Latvia is 
designated LSS because only Latvian-speaking schools were tested, which represents less than 65 percent of the 
population. 

3. Nations in which a participation rate of 75 percent of the schools and students combined was achieved only after 
replacements for refusals were substituted, are shown with a °. 

4 The international average is the average of the national averages of the 4 1 nations. 
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DATA REPRESENTATION, 


ANALYSIS, 




& PROBABILITY 
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MEASUREMENT 
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PROPORTIONALITY 



Nation Percent Correct 




SINGAPORE 


75 




HONGKONG 


62 




KOREA 


62 




JAPAN 


61 




BELGIUM-FLEMISH 0 


53 




SWITZERLAND 0 


52 




CZECH REPUBLIC 


52 




(NETHERLANDS) 


51 




(THAILAND) 


51 




IRELAND 


51 




(SLOVENA) 


49 | 


SLOVAK REPUBLIC 


49 j 


(AUSTRA) 


49 i 


FRANCE 


49 : 


RUSSIAN FEDERATION 


48 j 


CANADA 


48 i 


(BELGIUM-FRENCH) 


48 ; 


HUNGARY 


47 * 


(BULGARA) 


47 


(AUSTRALA) 

SWEDEN 


::<§ 


(ISRAEL) * 


43 


NEW ZEALAND 


42 


UNITED STATES 0 


42 


(GERMANY) *° 


42 


(ROMANA) 


42 


ENGLAND *° 


41 


(DENMARK) 


41 


NORWAY 


40 


SPAIN 


40 


(SCOTLAND) 


40 


CYPRUS 


40 


(GREECE) 


39 


LATVA (LSS) ° 


39 


ICELAND 


36 


IRAN, ISLAMIC REPUBLIC36 


LITHUANA *° 


35 


PORTUGAL 


32 


(COLOMBA) 


23 


(SOUTH AFRICA) 


21 


(KUWAIT) 


21 



SOURCE: 

Beacon et a!. (1996) Mothemotics 
Achievement in the middle school years. 
Table 1 . 1 . Boston College: Chestnut 
Hill. MA. 



O Percent significantly higher than U.S. 

O Percent not significantly different than U.S. 

O Percent significantly lower than U.S. 

<#) International average percent correct, all nations 
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FIGURE 6: 

National Averages in Science Content Areas 



EARTH SCIENCE 



LIFE SCIENCE 



PHYSICS 



NATIONS WITH SCORES 


SIGNIFICANTLY HIGHER 


THAN THE U.S. 




NATION PERCENT CORRECT 


SINGAPORE 


65 


(SLOVENIA) 


64 


CZECH REPUBLIC 


63 


KOREA 


63 




NATIONS WITH SCORES NOT 


SIGNIFICANTLY DIFFERENT 


FROM THE U.S. 




NATION PERCENT CORRECT 


BELGIUM-FLEMISH ° 


62 


(AUSTRIA) 


62 


SWEDEN 


62 


NORWAY 


61 


IRELAND 


61 


(NETHERLANDS) 


61 


JAPAN 


61 


SLOVAK REPUBLIC 


60 


HUNGARY 


60 


ENGLAND *° 


59 


RUSSIAN FEDERATION 


58 


(BULGARIA) 


58 


UNITED STATES 0 


58 


SWITZERLAND ° 


58 


CANADA 


58 


(AUSTRALIA) 


57 


(GERMANY) *° 


57 


SPAIN 


57 


(THAILAND) 


56 


NEW ZEALAND 


56 


(ISRAEL) * 


55 A 


FRANCE 


55^ 


HONG KONG 


54 




NATIONS WITH SCORES 


SIGNIFICANTLY LOWER 


THAN THE U.S. 




NATION PERCENT CORRECT 


(SCOTLAND) 


52 


PORTUGAL 


50 


(BELGIUM-FRENCH) 


50 


ICELAND 


50 


(ROMANIA) 


49 


(GREECE) 


49 


(DENMARK) 


49 


LATVIA (LSS)° 


48 


LITHUANIA* 


46 


CYPRUS 


46 


IRAN. ISLAMIC REPUBLIC 


45 


(KUWAIT) 


43 


(COLOMBIA) 


37 


(SOUTH AFRICA) 


26 



NATIONS WITH SCORES 


SIGNIFICANTLY HIGHER 


THAN THE U.S. 




NATION PERCENT CORRECT 


SINGAPORE 


72 


JAPAN 


71 


KOREA 


70 


CZECH REPUBLIC 


69 




NATIONS WITH SCORES NOT 


SIGNIFICANTLY DIFFERENT 


FROM THE U.S. 




NATION PERCENT CORRECT 


(NETHERLANDS) 


67 


(THAILAND) 


66 


HUNGARY 


65 


(AUSTRA) 


65 


(SLOVEN A) 


65 


(BULGARA) 


64 


ENGLAND *° 


64 


BELGIUM-FLEMISH 0 


64 


(AUSTRALA) 


63 


(GERMANY) *° 


63 


UNITED STATES ° 


63 


SWEDEN 


63 


RUSSIAN FEDERATION 


62 


CANADA 


62 


HONG KONG 


61 


NORWAY 


61 


(ISRAEL) * 


61 


NEW ZEALAND 


60 


SLOVAK REPUBLIC 


60 


IRELAND 


60 


SWITZERLAND 0 


59<£ 


ICELAND 


58 




NATIONS WITH SCORES 


SIGNIFICANTLY LOWER 


THAN THE U.S. 




NATION PERCENT CORRECT 


SPAIN 


58 


(SCOTLAND) 


57 


FRANCE 


56 


(DENMARK) 


56 


(ROMANA) 


55 


(BELGIUM-FRENCH) 


55 


(GREECE) 


54 


PORTUGAL 


53 


LATVA (LSS) ° 


53 


LITHUANA * 


52 


IRAN, ISLAMIC REPUBLIC 


49 


CYPRUS 


49 


(KUWAIT) 


45 


(COLOMBA) 


44 


(SOUTH AFRICA) 


27 



NATIONS WITH SCORES 


SIGNIFICANTLY HIGHER 


THAN THE U.S. 




NATION PERCENT CORRECT 


SINGAPORE 


69 


JAPAN 


67 


KOREA 


65 


CZECH REPUBLIC 


64 


(NETHERLANDS) 


63 


(AUSTRA) 


62 


ENGLAND *° 


62 


SLOVAK REPUBLIC 


61 


(SLOVENA) 


61 


BELGIUM-FLEMISH 0 


61 


(BULGARA) 


60 


(AUSTRALA) 


60 


HUNGARY 


60 




NATIONS WITH SCORES NOT 


SIGNIFICANTLY DIFFERENT 


FROM THE U.S. 




NATION PERCENT CORRECT 


CANADA 


59 


HONG KONG 


58 


NEW ZEALAND 


58 


SWITZERLAND ° 


58 


RUSSIAN FEDERATION 


57 


(GERMANY) *° 


57 


SWEDEN 


57 


(ISRAEL) * 


57 


(SCOTLAND) 


57 


NORWAY 


57 


IRELAND 


56 


UNITED STATES ° 


56 


SPAIN 


55 <t 


FRANCE 


54 


(THAILAND) 


54 


ICELAND 


53 


(GREECE) 


53 


(DENMARK) 


53 




NATIONS WITH SCORES 


SIGNIFICANTLY LOWER 


THAN THE U.S. 




NATION PERCENT CORRECT 


(BELGIUM-FRENCH) 


51 


LATVIA (LSS) ° 


51 


LITHUANA * 


51 


(ROMANA) 


49 


PORTUGAL 


48 


IRAN, ISLAMIC REPUBLIC 


48 


CYPRUS 


46 


(KUWAIT) 


43 


(COLOMBA) 


37 


(SOUTH AFRICA) 


27 



o 

ERLC 



"31 



CHEMISTRY 



ENVIRONMENTAL ISSUES 
& THE NATURE OF SCIENCE 
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NOTES: 

1. Nations not meeting international 
study guidelines are shown in pa- 
rentheses. 

2. Nations in which more than 10 
percent of the population was ex- 
cluded from testing are shown 
with a *. Latvia is designated LSS 
because only Latvian-speaking 
schools were tested, which repre- 
sents less than 65 percent of the 
population. 

3. Nations in which a participation 
rate of 75 percent of the schools 
and students combined was 
achieved only after replacements 
for refusals were substituted, are 
shown with a °. 

4. The international average is the av- 

erage of the national averages of 
the 41 nations. 

SOURCE: 

Beaton et al. ( 1 996) Science achieve- 
ment in the middle school years . Table 

2.1. Boston College: Chestnut Hill, 
MA. 

<#)AVERAGE PERCENT 
CORRECT 



■ Life Science (structure, diversity, clas- 
sification, processes, cycles, and in- 
teractions of plants and animals). 

■ Physics (energy forms, physical trans- 
formations, force and motion, and 
physical properties of matter). 

Figure 6 on pages 30 and 3 1 shows our 
comparative standing in these content 
areas. The U.S. is among the top coun- 
tries in the world in Environmental Is- 
sues and the Nature of Science, and we 
are also above the international average 
in Earth Science and Life Science. In 
Chemistry and Physics, our perfor- 
mance is not significantly different 
from the international average. Our 
better-than-average scores in Environ- 
mental Issues, Earth Science, and Life 
Science may pull our overall science 
score up to above average. 



WHAT DID PRIOR STUDIES SHOW 
ABOUT HOW U.S. STATES 
COMPARE TO OTHER COUNTRIES? 

Comparison of U.S. states with other 
nations reminds us that not all U.S. 
school systems are alike, and that wide 
differences in achievement exist 
within our own nation. Some would 
say that comparisons of U.S. states and 
other nations are fair for two reasons. 
First, most U.S. states are larger either 
in size or population than many coun- 
tries in the TIMSS study. For example, 
California is larger in size than Japan, 
Germany, or England. New Jersey has a 
larger population than Austria, Den- 
mark, or Switzerland. A second reason 
that such comparisons are fair is that 
each U.S. state is responsible for its own 
education system, similar to the way in 



which most other TIMSS national gov- 
ernments are responsible for their own 
education system. 

Future analyses may make possible such 
comparisons between U.S. states and 
the TIMSS nations. Efforts are now 
underway to create an experimental 
linkage between the TIMSS study and 
the mathematics and science portions of 
the National Assessment of Educational 
Progress (NAEP). This linkage will al- 
low an estimation of how states would 
have performed on TIMSS if their stu- 
dents had taken the test. The results 
for eighth-grade mathematics and sci- 
ence will be announced in 1997. 

Until those findings are released, how- 
ever, we can look at the results of a 
similar linkage which was performed 
in 1991 for eighth-grade mathematics 
students’ scores on NAEP and on the 
International Assessment of Educa- 
tional Progress 4 . In that comparison, 
the mathematics scores of Iowa, 
North Dakota, and Minnesota were 
similar to top-scoring Taiwan and 
Korea. In contrast, Alabama, Loui- 
siana, and Mississippi scored about 
the same as lowest-scoring Jordan. 
These findings underscore the con- 
siderable variation in achievement 
that exists among states within our own 
nation. 

HAS U.S. INTERNATIONAL 
STANDING IMPROVED OVER 
TIME? 

Results from the National Assess- 
ment of Education Progress show that 
our eighth-grade students’ scores in 
math and science have improved some- 



what in comparison to our own perfor- 
mance during the past decades. If our 
domestic performance over time is im- 
proving, how does this affect our inter- 
national standing? It is possible that 
only U.S. achievement has improved 
over time, while achievement in other 
countries has not. Of course, it is also 
possible that improvements in the U.S. 
have been matched or exceeded by im- 
provements in other countries. 

International" comparisons over time are 
difficult. The first international studies 
of math and science achievement were 
conducted in the 1960s, and there have 
been three previous assessments in each 
subject since that time. However, each 
assessment has been done differently. A 
different set of nations participated, dif- 
ferent topics in math and science were 
included in the tests, the age and type 
of students sampled in each country 
changed slightly, and indeed even the 
borders and names of some of the na- 
tions have changed. Furthermore, the 
field of assessment has matured greatly 
over the past thirty years, rendering the 
methods of the then-revolutionary early 
studies crude by today’s standards. 
These and other factors complicate com- 
parisons over time, and require that any 
conclusions that are drawn be necessar- 
ily tentative. 



In TIMSS mathematics, we have seen 
that our eighth-graders scored below the 
international average. This is basically 
the same relative international standing 
reported for U.S. thirteen-year-olds in 
the IEA First and Second International 
Mathematics Studies in the 1960s and 
1980s, and the mathematics portion of 
the International Assessment of Educa- 
tional Progress in the early 1 990s 5 . Rela- 
tive to their international counter- 
parts, it is not likely that U.S. eighth- 
graders , standing in mathematics has 
improved significantly. 

In the three previous international 
science assessments in the 1960s, 
1980s, and early 1990s, the U.S. per- 
formed below the international average 
of thirteen or fourteen-year-olds. How- 
ever in TIMSS, our students scored at 
or above the international average. Be- 
cause comparisons over time are dif- 
ficult, caution should be exercised in 
assuming there has been significant 
improvement in our international 
standing in science, but it is a possi- 
bility. 

We have now examined what TIMSS 
tells us about what eighth-grade stu- 
dents have learned. Learning, of course, 
is closely related to what students are 
taught. Next we turn to an examina- 
tion of how the U.S. mathematics and 
science curricula compare with those of 
other nations. 
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CHAPTER 2: 
CURRICULUM 



KEY POINTS: 



The content taught in U.S. eighth-grade 
mathematics classrooms is at a seventh- 
grade level in comparison to other countries. 



Topic coverage in U.S. eighth-grade 
mathematics classes is not as focused as in 
Germany and Japan. 



In science, the degree of topic focus in the 
eighth-grade curriculum may be similar to 
that of other countries. 



Our nation is atypical among TIMSS 
countries in its lack of a nationally-defined 
curriculum. 



U.S. eighth graders spend more hours per 
year in math and science classes than 
German and Japanese students. 




35 



U.S. policy makers are concerned about 
whether standards for our students are 
high enough, and, in particular, whether 
they are as challenging as those of our 
foreign economic partners. There is a 
widespread belief that our nation’s eco- 
nomic productivity is related to our stu- 
dents’ performance in mathematics and 
science, and that this in turn is related 
to the expectations that are set for stu- 
dent performance. 

However, the relationship between stan- 
dards, teaching, and learning is not a 
simple one. Formal and informal deci- 
sions at many levels affect what stu- 
dents are taught. National, state, and 
local authorities as well as publishers 
set forth the officially intended curricu- 
lum in both curriculum guidelines and 
textbooks. Teachers also make deci- 
sions about what should be taught. De- 
pending on the country, their decisions 
are based more or less closely on the of- 
ficially intended curriculum. What 



teachers actually teach their students is 
sometimes called the “implemented cur- 
riculum.” Both the officially intended 
curriculum and the implemented cur- 
riculum must be considered when dis- 
cussing a nation’s goals for student learn- 
ing. 

WHO SETS CURRICULUM 
STANDARDS? 

In most TIMSS countries, the curricu- 
lum is determined by national au- 
thorities. Figure 7 shows that curricu- 
lum is determined at the national level 
in 29 of the TIMSS countries, at the 
state or region in 3 countries, and at the 
local or district level in 9 countries. 
Germany, Japan, and the U.S. differ in 
this respect, which makes comparisons 
among the three countries interesting. 
Which authority sets a country’s offi- 
cial curriculum standards makes a dif- 
ference in whether or not there is a single 



FIGURE 7 

Number of TIMSS Countries Determining 
Curriculum at Various Levels 




National 
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29 COUNTRIES 
INCLUDING 

Japan 



SOURCE: 

Beaton et al. ( 1 996) Mathematics achievement in the middle school years. Figure I . 
Boston College: Chestnut Hill. MA. 




official core curriculum for the entire na- 
tion, or whether there are as many offi- 
cial curricula as there are states or dis- 
tricts in the country. 

Japan is one of the countries that de- 
termines curriculum at the national 
level. The National Ministry of Educa- 
tion specifies one set of curriculum 
guidelines that details the topics of study 
and the number of instructional hours 
required in every accredited elementary 
and junior high school. For these school- 
ing levels, it also approves textbooks 
published by six commercial publishers. 
Textbooks resemble each other in con- 
tent because they must be based closely 
on the national guidelines. Local school 
boards make only minor modifications 
to the national guidelines, and choose 
textbooks from among the approved list. 
However, the Ministry itself does not 
monitor whether or not the standards 
are adhered to, leaving the issue of 
oversight to the local boards of edu- 
cation. Teachers of each subject in a 
school work together closely to be 
sure that they cover the material in 
the textbooks at approximately the 
same depth and rate. This is partly 
due to the oversight of local authorities, 
and partly due to teachers’ desire that 
their students score well on the high- 
school entrance examination, which is 
based directly on the national curricu- 
lum. 

In Germany, each of the 16 states 
sets its own curriculum standards 
for students. To encourage some de- 
gree of similarity across states, the na- 
tional Conference of Ministers of Edu- 
cation discusses various issues related 
to standards and adopts broad recom- 
mended guidelines concerning curricu- 
lum, hours of instruction, and exami- 
nation guidelines. State curriculum 
standards vary widely in their level of 



specificity, and the degree to which 
schools and teachers are held account- 
able for following them. Teachers in 
states where curriculum guidelines are 
not highly specific, and where schools 
and districts are allowed to develop their 
own secondary school exit examinations, 
have considerable flexibility in determin- 
ing what and how they teach. 

In the U.S., most of the nearly 16,000 
districts design their own curriculum 
or standards, usually within broad 
guidelines issued by each of the 50 
states. There are many different com- 
mercially published textbooks. Because 
most textbooks are designed with an 
eye to sales in as many districts as pos- 
sible, they include the content speci- 
fied by the guidelines from a number of 
different states. As a result, textbooks 
usually contain much more material 
than a teacher can cover fully in a year. 
Each of the many different textbooks 
includes somewhat different topics from 
which teachers in various districts can 
choose. Few states or districts closely 
monitor or enforce compliance with 
state or district standards, and U.S. 
teachers usually have the latitude to de- 
sign the content and pace of their 
courses to suit their perception of their 
students’ needs. 



IS CURRICULUM IN THE U.S. 

AS FOCUSED AS IN OTHER 
COUNTRIES? 

Evidence from a variety of sources 
in TIMSS shows us that the U.S. 
mathematics curriculum is less fo- 
cused than that of other countries. 
The U.S. science curriculum more 
closely resembles international prac- 
tices. 
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The TIMSS curriculum analysis stud- 
ied the officially intended curriculum by 
asking U.S. curriculum experts to judge 
which topics were recommended to be 
taught at each grade level. Their judg- 
ments were compared with those of ex- 
perts in the other TIMSS countries. 
This effort revealed that the number of 
topics recommended to be covered in the 
U.S. was greater than the international 
average at each of grades 1 through 8 
for mathematics. 

Textbooks are another aspect of the of- 
ficially intended curriculum. Video- 
tapes of mathematics classes in Ger- 
many Japan, and the U.S. showed that 
textbooks were used during class in al- 
most half of U.S. lessons and a third of 
German lessons, but in only 2 percent 
of Japanese lessons. Teacher-developed 
worksheets were common in U.S. and 
Japanese lessons. In Japan, students also 
use supplementary practice books which 
are usually purchased from the school 
for use in home study. 

The TIMSS curriculum analysis com- 
pared the most commonly used text- 
books in the various countries. For the 
U.S. portion of this analysis, mathemat- 
ics experts were asked to recommend the 
most commonly-used U.S. eighth-grade 
textbooks in these subjects. The TIMSS 
questionnaire surveys of teachers found 
that these chosen texts were indeed 
among the most widely used books in 
the U.S, although they accounted for the 
textbooks used by only 28 percent of the 
students. This finding that the five rec- 
ommended textbooks covered a fairly 
small proportion of students is an indi- 
cation of the great diversity of textbooks 
in our country. In Japan, close to 90 
percent of the students used one of the 
five most common textbooks. Analysis 



found that the set of 5 U.S. eighth-grade 
texts included more different topics 
across all the texts than the set of texts 
in Japan and Germany. 

Of course, not all teachers cover every 
topic recommended by curriculum ex- 
perts, or included in textbooks. There- 
fore, TIMSS also studied the imple- 
mented curriculum — what teachers ac- 
tually cover in their classrooms. Using 
the same definitions of mathematics top- 
ics that the curriculum analysis used, the 
videotape study of eighth-grade math- 
ematics lessons in Germany, Japan, and 
the U.S. revealed that U.S. lessons in- 
clude a greater number of topics. On 
average, U.S. teachers taught 1 .9 topics 
per lesson, compared with 1 .6 in Ger- 
many and 1 .3 in Japan. The variety of 
topics was much wider in the U.S., too. 

In science, the officially intended cur- 
riculum as reflected by U.S. curricu- 
lum experts’ recommendations about 
topics to be taught was close to the 
international average for grades 3 
through 8. Science experts in each 
country chose the three most common 
textbooks used in their classrooms, 
which were found to be used by 1 6 
percent of students in the U.S., and 84 
percent of students in Japan. 

Thus, the evidence from a variety of 
TIMSS sources reinforces the finding 
that our eighth-grade mathematics cur- 
riculum is less focused than the cur- 
ricula of other nations, if focus is de- 
fined as number and variety of topics 
in the intended and implemented cur- 
riculum. Although less information is 
available for science, U.S. curricular fo- 
cus may be more similar to the average 
of the TIMSS countries in this subject. 





IS CURRICULUM IN THE U.S. . 

AS ADVANCED AS IN OTHER 
COUNTRIES? 

The U.S. mathematics curriculum is 
not as advanced as in Germany and 
Japan. Concerning the intended cur- 
riculum, analysis of textbooks found that 
Geometry occupied more space in the 
German and Japanese books than in the 
U.S. texts. The Japanese textbooks also 
devoted more space to algebra than did 
the books studied by the majority of 
U.S. eighth graders, who are in non -al- 
gebra tracks. 

The implemented curriculum in the U.S. 
is also less advanced than that of Germany 
and Japan. In the videotapes studied, 40 
percent of U.S. eighth-grade mathemat- 
ics lessons included arithmetic topics such 
as whole number operations, fractions, 
and decimals, whereas these topics were 
much less common in Germany and Ja- 
pan. In contrast, German and Japanese 
eighth-grade lessons were more likely to 
cover algebra and geometry 

The topics being taught in U.S. math- 
ematics classrooms were at a seventh- 
grade level in comparison to other coun- 
tries, while the topics observed in the 
German and Japanese classrooms 
were at a high eighth-grade or even 
ninth-grade level. This was discovered 
based on a comparison of the TIMSS 
curriculum analysis and videotape stud- 
ies. The curriculum analysis asked ex- 
perts in each of the TIMSS countries 
to report the grade level at which their 
country focused on various topics. 
These findings were compared to the 
topics which the TIMSS videotape 
study observed eighth-grade teachers in 
Japan, Germany, and the U.S. to be ac- 
tually teaching. 



TIMSS does not have data to judge 
whether the U.S. curriculum in science 
is as advanced as that of other countries 
because the videotape study was con- 
ducted only in mathematics. 



HOW MUCH TIME IS SPENT IN CLASS? 

Lengthening the school year or school 
day has often been proposed as a mea- 
sure to improve U.S. students’ achieve- 
ment, as it has been thought that U.S. 
students spend less time at school than 
their international counterparts. 
TIMSS compared the amount of time 
that teachers report U.S. students 
spend in mathematics and science 
classes with the amount of time re- 
ported for students in Germany and 
Japan. In contrast to previous analy- 
ses, TIMSS carefully took into ac- 
count differences between countries 
in the length of the school year, school 
week, and class period, as well as differ- 
ences between the amount of time re- 
quired for students in high and low 
tracks. On this basis, the average 
number of hours per year that a stu- 
dent in each country spends in math- 
ematics and science class was calculated. 

U.S. eighth-graders spend consider- 
ably more hours per year in math- 
ematics classes than their Japanese 
and German counterparts. U.S. stu- 
dents also spend much more time in sci- 
ence classes than students in Japan. Fig- 
ure 8 on page 39 shows the amount of 
time that students in the different coun- 
tries spend in math and science classes 
per year. U.S. students’ instructional 
time is both longer and more com- 
pressed, because it takes place within a 
school year of approximately 1 80 days, 
as compared to 1 88 in Germany and 220 



in Japan. Of course, time spent in home- 
work, after-school classes, and out-of- 
school study is also an important factor 
in learning, and findings concerning 
these topics will be examined in Chap- 
ter 5 . 

Taken together, TIMSS curriculum-re- 
lated findings show that lack of suffi- 
cient class time is not the easy answer 



to the question of why U.S. students 
are below the international average 
in mathematics. Instead, findings 
suggest that our students receive a 
less-advanced curriculum, which is 
also less focused. Next we will con- 
sider how this curriculum is taught by 
examining the findings concerning class- 
room teaching. 



FIGURE 8 

Hours of Mathematics and Science Instructional 
Time per Year for Eighth-Graders 
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CHAPTER 3: 
TEACHING 



KEY POINTS: 



The content of U.S. mathematics classes 
requires less high-level thought than classes in 
Germany and Japan. 

U.S. mathematics teachers’ typical goal is to 
teach students how to do something, while 
Japanese teachers’ goal is to help them 
understand mathematical concepts. 

Japanese teachers widely practice what the U.S. 
mathematics reform recommends, while U.S. 
teachers do so less frequently. 

Although most U.S. math teachers report 
familiarity with reform recommendations, only a 
few apply the key points in their classrooms. 
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During the past several years, mathemat- 
ics professional organizations, concerned 
about the quality of instruction in U.S. 
classrooms, have issued calls for reform. 
In 1 989, the National Council of Teach- 
ers of Mathematics (NCTM) set forth 
Curriculum and Evaluation Standards , fol- 
lowed in 1991 by Professional Standards 
for Teaching Mathematics, and in 1995 by 
Assessment Standards. The essence of the 
recommendations in these reform docu- 
ments is that instruction should be more 
than mere mastery of facts and routine 
skills. It should require students to un- 
derstand and apply mathematical con- 
cepts in new situations. 

Publication and discussion of docu- 
ments such as these, however, do not 
change the behavior of all of America’s 
hundreds of thousands of mathemat- 
ics teachers within a few years. Rec- 
ommendations for major changes in 
other areas of American life, such as 
improving health through regular exer- 
cise and proper diet, have required de- 
cades of sustained effort by public health 
organizations at all levels to assist in- 
dividual citizens in changing in- 
grained personal habits and atti- 
tudes. Indeed, the campaign still 
continues. Changing our nation’s 
habits of teaching and public atti- 
tudes toward mathematics and sci- 
ence may also require a similarly long 
and concerted effort by many commit- 
ted people. 

TIMSS was not designed as an evalua- 
tion of the U.S. mathematics reform 
efforts described in the documents 
listed above. There are three reasons 
why TIMSS is unsuitable as such an 
evaluation. First, because it is an inter- 
national study, it was designed to mea- 
sure those aspects of mathematics and 
science knowledge and practice consid- 
ered important by the majority of 



TIMSS nations, rather than those spe- 
cifically recommended by the U.S. re- 
form community. Second, TIMSS 
tested U.S. students in the spring of 
1 995, which was too soon after the pub- 
lication of the reform documents for 
states and districts to have designed their 
own reform programs, retrained teach- 
ers in the new practices, and nurtured a 
generation of students according to the 
new approach. Third, a proper evalua- 
tion requires matching “before and af- 
ter” measurements between which 
progress can be judged, and we have no 
prior measurement which matches 
TIMSS. For these reasons, TIMSS is 
not suitable as an evaluation. It should 
be studied as a baseline measurement 
against which future progress can be 
gauged. 

Until TIMSS, no large nationally-rep- 
resentative study had observed U.S. 
classrooms to watch how teachers ac- 
tually teach. To overcome this lack, 
and to understand how U.S. classroom 
teaching compares to that of other 
countries, NCES added an innovative 
new research methodology to the 
TIMSS project — videotaping and 
quantitative coding of a national 
sample of eighth-grade mathematics 
classes in Germany, japan, and the 
U.S. 

In the U.S. and Germany, half of the 
eighth-grade mathematics class- 
rooms in which students were sched- 
uled to take the TIMSS test were ran- 
domly chosen to be filmed. In Japan, 
50 classrooms from the schools in which 
the TIMSS test was administered were 
chosen by the principal and officials at 
the National Institute for Educational 
Research. Teachers whose classrooms 
were chosen and who agreed to partici- 
pate were videotaped teaching a typical 
lesson. In this way, videotapes of 230 




lessons were collected in the three coun- 
tries combined. The videotapes were 
then coded and analyzed to compare the 
teaching techniques and lesson content 
typical of the three countries. Teachers 
also completed a questionnaire concern- 
ing the lesson that was videotaped. The 
findings can be considered representa- 
tive of the type of instruction received 
by German, Japanese, and U.S. eighth- 
grade mathematics students. The results 
provide a window on actual teaching in 
U.S. classrooms, and also show how U.S. 
mathematics classes compare to those 
in Germany and Japan. 

HOW DO MATHEMATICS TEACHERS 
STRUCTURE AND DELIVER THEIR 
LESSONS? 

When studying what teachers do in 
their classrooms, we should first un- 
derstand what they mean to do. 
Therefore, the videotape study asked 



teachers about their goals for the lesson. 
In contrast to expert recommendation 
that well-taught lessons focus on hav- 
ing students think about and come to 
understand mathematical concepts, 
U.S. and German eighth-grade math- 
ematics teachers usually explained 
that the goal of their lesson was to 
have students acquire particular 
skills, i.e. to learn how to do something. 
Learning a skill, such as being able to 
solve a certain type of problem, or using 
a standard formula, was listed as the goal 
by about 60 percent of the U.S. and Ger- 
man teachers, compared with 27 percent 
of the Japanese teachers. Japanese 
teachers’ goals were more likely to re- 
semble the recommendations of U.S. 
reform experts. Mathematical thinking, 
such as exploring, developing, and un- 
derstanding concepts, or discovering 
multiple solutions to the same problems, 
was described as the goal of the lesson 
by 7 1 percent of the Japanese teachers. 



FIGURE 9: 

Comparison of the Steps Typical of Eighth-Grade Mathematics Lessons in Japan, the 

U.S., and Germany 



The emphasis on understanding is evident in the steps typical of Japa- 
nese eighth-grade mathematics lessons: 

■ Teacher poses a complex thought-provoking problem. 

■ Students struggle with the problem. 

■ Various students present ideas or solutions to the class. 

■ Class discusses the various solution methods. 

■ The teacher summarizes the class’ conclusions. 

■ Students practice similar problems. 



In contrast, the emphasis on skill acquisition is evident in the 
steps common to most U.S. and German math lessons: 

■ Teacher instructs students in a concept or skill. 

■ Teacher solves example problems with class. 

■ Students practice on their own while the teacher assists 
individual students. 

SOURCE: 

Third International Mathematics and Science Study: unpublished tabulations, Videotape Classroom Study, UCLA, 1996. 



compared with 29 percent of German 
and 24 percent of U.S. teachers. This 
difference in goals is played out in the 
typical sequences of activities, or cultural 
scripts, which characterize mathematics 
lessons in the three countries. Figure 9 
on page 42 describes the steps typical 
of these cultural scripts. 

The U.S. and German emphasis on 
skills rather than understanding is 
also carried over into the type of 
mathematical work that students are 
assigned to do at their desks during 
class. Students were coded as practic- 
ing routine procedures if their seatwork 
required them to carry out a previously- 
learned solution method or procedure 
on a routine problem. In the U.S., 
96 percent of seatwork time was 
spent on routine procedures, in com- 
parison to 89 percent in Germany, 
and 41 percent in Japan. Students 
were assigned to invent new solu- 
tions, proofs, or procedures on their 
own which require them to think and 
reason in 44 percent of Japanese, 4 
percent of German lessons, and less 
than 1 percent of U.S. lessons. 
Clearly, Japanese students much 
more often engage in the type of 
mathematical thinking recommended 
by experts and the U.S. reform move- 
ment. 

When a lesson included a mathemati- 
cal concept, it was usually simply 
stated in U.S. classrooms, whereas 
it was developed in Japanese and 
German ones. For example, consider 
a lesson on the Pythagorean theo- 
rem. When the concept is merely 
stated, the teacher or a student might 
simply say “we find the length of the 
hypotenuse of a right triangle by us- 
ing a 2 + b 2 = c 2 .” In contrast, a con- 
cept was coded as having been de- 



veloped if it was proven, derived, or ex- 
plained in some detail. 

Figure 10 on page 44 shows that U.S. 
teachers rarely developed concepts, in 
contrast to German and Japanese 
teachers, who usually did. In Germany, 
the teacher usually did the mental 
work in developing the concept, while 
the students listened or answered 
short questions designed to add to the 
flow of the teacher’s explanation. Japa- 
nese teachers, however, designed the les- 
son in such a way that the students 
themselves derived the concept from 
their own struggle with the problem. 

These findings from the videotape study 
are corroborated by the TIMSS ques- 
tionnaire findings. Teachers were asked 
to choose activities that were charac- 
teristic of their teaching from among 
those listed on the questionnaire. U.S. 
math teachers were more likely to re- 
port asking students to practice com- 
putational skills, in most or every class 
than were their German and Japa- 
nese colleagues. Similarly, Japanese 
teachers were more likely to report 
they ask students to analyze relation- 
ships, write equations, explain their 
reasoning, and solve problems with 
no obvious solution in most or every 
class than teachers in the U.S. and 
Germany. 

Linking concepts used in one part of the 
lesson to ideas or activities in another 
part of the lesson is believed by experts 
to improve students’ ability to learn and 
understand a subject in an integrated 
way. The videotape study found that 
96 percent of Japanese lessons included 
such explicit linkages in comparison to 
about 40 percent of U.S, and German 
lessons. Talking about such relationships 
may help make lessons more coherent 





FIGURE 10 

Average Percentage of Topics in Eighth-Grade 
Mathematics Lessons that Are Stated or Developed 
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for students by showing them the rela- 
tionships between ideas and activities 
used in different parts of the lesson. 

Interruptions present a threat to the co- 
herence of lesson activities. The study 
found that the flow of mathematics les- 
sons was more frequently interrupted 
than in Germany and Japan. One U.S. 
math lesson in four was temporarily 
halted by an outside interruption, typi- 
cally a loudspeaker announcement, or a 
visitor at the door. In contrast, inter- 
ruptions in German lessons were much 
less common, and the Japanese lessons 
observed in the study never experienced 
outside interruptions. Interruptions 
coming from within the classroom were 
also more common in U.S. mathemat- 
ics lessons, such as substantial discus- 
sion of non-mathematical subjects like 
recent sports events, or extended disci- 
plinary incidents. In the U.S., 23 per- 
cent of lessons were broken up in this 
way compared to 9 percent in Japan, and 
4 percent in Germany. 



Taken together, these findings suggest 
that Japanese rather than U.S. or Ger- 
man lessons more often resembled the 
recommendations of experts and the 
U.S. reform movement. U.S. lessons 
typically focused on acquiring math- 
ematical skills rather than conceptual 
understanding, and were less coher- 
ently presented. 

IS THE MATHEMATICAL CONTENT OF 
U.S. LESSONS AS RICH AS THAT IN 
GERMANY AND JAPAN? 

As noted earlier, the U.S. eighth-grade 
mathematics curriculum focuses more 
on arithmetic, while the German and 
Japanese curricula focus more on geom- 
etry and algebra. Furthermore, U.S. 
eighth graders are studying topics usu- 
ally learned at the seventh grade in most 
other TIMSS countries. 

How does the quality of the math- 
ematical reasoning used in U.S. 
classrooms compare with that in 



Germany and Japan? Videotape re- 
searchers requested the assistance of 3 
mathematics professors and one profes- 
sor of mathematics education in evalu- 
ating the quality of the mathematics con- 
tained in the videotaped lessons. This 
group of four experts was asked to judge 
the quality of the “story” formed by the 
sequence of mathematical ideas in a ran- 
dom sample of 90 of the lessons divided 
evenly among each of the three coun- 
tries, They studied such factors as the 
coherence of the sequencing, the type 
of reasoning required of students, the in- 
crease in cognitive complexity between 
the beginning and end of the lesson, and 
the way in which the problems and ex- 
amples contributed to the lesson’s cen- 
tral concept. 

To ensure that the experts were not 
unconsciously biased toward any 
country, they were not allowed to actu- 
ally see the videotapes. Instead, they 
were provided with a written summary 
of each lesson’s sequence of mathemati- 
cal statements and equations, as well as 
how these were embedded in learning 
activities. The summaries were carefully 



reviewed to disguise any words such as 
“yen,” or “football,” or other hints 
which might indicate the country in 
which the lesson was taught. Each ex- 
pert first independently rated the over- 
all quality of the mathematical content 
of each lesson as either low, medium, or 
high. After comparing their ratings, they 
found high agreement among their judg- 
ments. Figure 1 1 below shows their 
judgments. 

None of the U.S. lessons was consid- 
ered to contain a high-quality se- 
quence of mathematical ideas, com- 
pared to 30 percent of the Japanese, 
and 23 percent of the German lessons. 
Instead, the lowest rating was assigned 
to the mathematical reasoning used in 
87 percent of the U.S. lessons, in com- 
parison to 40 percent of the German 
and 13 percent of Japanese lessons. 
This finding does not mean that there 
are no lessons with high-quality 
mathematical reasoning anywhere in 
the U.S. However, it does indicate 
that they are probably a rare phe- 
nomenon. 



FIGURE 1 1 

Expert Judgements of the Quality of the Mathematical Content 
of Eighth-Grade Lessons 
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These findings that our nation’s eighth- 
grade mathematics classes are based on 
less challenging material, and lack math- 
ematically rich content suggest that our 
students have less opportunity to learn 
challenging mathematics than their 
counterparts in Germany and Japan. 

TO WHAT EXTENT ARE THE 
RECOMMENDATIONS OFTHE 
MATHEMATICS REFORM 
MOVEMENT BEING IMPLEMENTED? 

A great deal of effort has been in- 
vested in the reform of mathematics 
teaching in the U.S. in recent years. 
There is considerable agreement 
among experts about what good in- 
struction should look like. The main 
goal of the reform is to create class- 
rooms in which students are chal- 
lenged to think deeply about math- 
ematics and science, by discovering, 
understanding and applying con- 
cepts in new situations. For many 
years, Japanese mathematics educa- 
tors have closely studied U.S. edu- 
cation reform recommendations, and 
attempted to implement these and 
other ideas in their own country. 

Has the message about mathemat- 
ics reform penetrated to U.S. class- 
rooms? TIMSS data suggest that it 
is beginning to, but still only in limited 
ways. Ninety-five percent of U.S. 
teachers stated that they were either 
“very aware” or “somewhat aware” of 
current ideas about teaching and 
learning mathematics. When asked to 
list titles of books they read to stay in- 
formed about current ideas, one third 
of U.S. teachers wrote down the names 
of two important documents by the Na- 
tional Council of Teachers of Mathemat- 
ics, Curriculum and Evaluation Standards 



and Professional Teaching Standards. 

U.S. teachers believe that their lessons 
are already implementing the reform rec- 
ommendations, but the findings de- 
scribed so far in this chapter suggest that 
their lessons are not. When asked to 
evaluate to what degree the videotaped 
lesson was in accord with current ideas 
about teaching and learning mathemat- 
ics, almost 75 percent of the teachers 
respond either “a lot” or “a fair amount.” 
This discrepancy between teachers’ be- 
liefs and the TIMSS findings leads us 
to wonder how teachers themselves un- 
derstand the key goals of the reform 
movement, and apply them in the class- 
room. 

Teachers in the study were asked to 
describe which aspects of the video- 
taped lesson exemplified current 
ideas about teaching and learning 
mathematics. Most U.S. teachers’ 
answers fall into one of three catego- 
ries: 

■ Hands-on, real-world math - 38 
percent of the teachers mentioned 
lesson activities that apply math 
to daily life, such as temperature 
in Alaska, or that use a physical 
representation of a mathematical 
concept, such as geometric blocks. 

■ Cooperative learning - 31 percent 
of the teachers mentioned the use 
of peer tutoring, “study buddies,” or 
math discussion groups. 

■ Focus on thinking - 19 percent of 
the teachers mentioned focusing 
on conceptual thinking about 
math in preference to computational 
skills, or mention focusing on prob- 
lem solving. 

Over 80 percent of the teachers in the 
study referred to something other than 



a focus on thinking, which is the central 
message of the mathematics reform 
movement. The majority of the teach- 
ers cited examples of hands-on math or 
cooperative learning, which are tech- 
niques included among the reform rec- 
ommendations. However, these tech- 
niques can be used either with or with- 
out engaging students in real mathemati- 
cal thinking. In fact, the videotape study 
observed many examples of these tech- 
niques being conducted in the absence 
of high-quality mathematical content. 

These findings suggest that the in- 
structional habits and attitudes of 
U.S. mathematics teachers are only 
beginning to change in the direction 
of implementation of mathematics 
reform recommendations. Teachers’ 
implementation of the reform still 
concentrates on isolated techniques 
rather than the central message, 
which is to focus lessons on high-level 
mathematical thought. The finding 
that almost 20 percent of the teachers 
believed that they had implemented this 
focus on mathematical thinking, despite 
experts’ judgments that a high-quality 
sequence of mathematical ideas was vir- 
tually absent in their lessons, suggests 
that teachers may not yet understand 
what the reform movement means by 
this term. 

The videotape study found that, in 
many ways, Japanese teaching resembled 
the recommendations of the U.S. reform 
movement more closely than did Ameri- 
can teaching. Japan also scored among 
the top nations in the world on the 



TIMSS test. However, until more stud- 
ies of other high-scoring nations are car- 
ried out, we cannot be sure that there is 
a relationship between Japan’s high 
scores and its style of teaching. 

WHAT DO INITIAL FINDINGS 
SHOW ABOUT SCIENCE 
TEACHING? 

TIMSS provides less data about science 
teaching than about mathematics teach- 
ing, because the videotape study was 
conducted only in mathematics. How- 
ever, the TIMSS teacher and student 
questionnaires included some items 
about instructional practices which help 
us understand something about the 
teaching of science in Germany, Japan, 
and the U.S.. The questionnaire data 
has only begun to be analyzed, and more 
analyses will soon be completed. Pre- 
liminary analyses suggest that U.S. sci- 
ence teaching may resemble mathemat- 
ics teaching in some respects, and differ 
in others. Therefore, one should not as- 
sume that the videotape findings in 
mathematics apply to science or to other 
subjects. 

Taken together, the data suggest that 
the instruction in typical U.S. math- 
ematics classes is not of as high a 
quality as that in other countries. 
Next, we turn to the TIMSS findings 
concerning the teachers themselves. 
Do the daily working lives of U.S. 
teachers provide as much support for 
their instructional activities as those 
of other countries? 
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CHAPTER 4: 
TEACHERS' LIVES 



KEY POINTS: 



Unlike new U.S. teachers, new Japanese and 
German teachers receive long-term 
structured apprenticeships in their 
profession. 



Japanese teachers have more opportunities 
to discuss teaching-related issues than do 
U.S. teachers. 



U.S. teachers have more college education 
than their colleagues in all but a few TIMSS 
countries. 



Student diversity and poor discipline are 
challenges not only for U.S. teachers, but for 
their German colleagues as well. 
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Hoping to improve U.S. classroom in- 
struction, many policy makers have rec- 
ommended improvements in various as- 
pects of the U.S. teacher education sys- 
tem. Experts agree that both the qual- 
ity of the college preparation prospec- 
tive teachers receive as well as the qual- 
ity of the in-service training existing 
teachers receive are important. How- 
ever, each year, the percentage of newly- 
hired teachers is comparatively small in 
relation to the size of the existing teach- 
ing force. Therefore, many experts agree 
that, in the short run, the quickest way 
to improve students’ learning opportu- 
nities is to improve the instruction pro- 
vided by existing teachers. 

To better understand how the charac- 
teristics of teachers’ daily lives may or 
may not contribute to high-quality 
teaching, a team of twelve bilingual re- 
searchers each spent three months in 
German, Japanese, or U.S. schools, ob- 
serving and interviewing teachers, prin- 
cipals, and students. This activity was 
carried out as a supplement to the U.S. 
TIMSS effort. As this chapter will de- 
scribe, researchers found important dif- 
ferences between U.S. teachers’ oppor- 
tunities for professional learning and im- 
provement of their teaching, and the op- 
portunities of their Japanese and Ger- 
man counterparts. 



WHO TEACHES MATHEMATICS 
AND SCIENCE? 

U.S. teachers report that they have 
spent more years in college than 
teachers in all but a few of the 41 
TIMSS countries. Nearly half of the 
teachers of U.S. eighth-graders had a 
masters’ degree, a proportion which was 



exceeded by only four other TIMSS 
countries. In Japan, few teachers had 
more than a Bachelors’ degree with 
teacher training. In Germany, teachers 
complete 13 years of primary and sec- 
ondary school, followed by about six 
years of study at the university, after 
which they write a thesis and pass an 
examination to receive a degree consid- 
ered equivalent to a U.S. masters’ de- 
gree. 

Spending many years in college, how- 
ever, does not necessarily result in 
teachers who are experts in their fields. 
Many U.S. policy makers consider it im- 
portant for mathematics and science 
teachers to have a strong college back- 
ground in those subjects. TIMSS, how- 
ever, was unable to collect information 
on this topic due to the great variety of 
ways in which university training in 
mathematics and science is organized in 
the participating countries. 

Japanese and German teachers en- 
joy the security of the benefits and 
tenure which come from their status 
as civil servants. As civil servants, 
their jobs are highly protected, and 
they are comparatively free from con- 
cerns about labor-force downsizing 
or termination for incompetence. 

The typical teacher of U.S. eighth- 
grade math and science students was 
a woman in her forties, with about 
15 years of prior teaching experience. 
Forties was the norm for most of the 
other TIMSS countries. The typical 
teacher of German students was a 
man nearly fifty, who had been teach- 
ing for about 19 years; and the typi- 
cal teacher of Japanese students was 
a man in his late thirties, who had 
been teaching for 14 years. 
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HOW DO TEACHERS SPEND 
THEIRTIME? 

Teachers of the U.S. and German 
eighth-grade students teach more 
classes per week than Japanese teach- 
ers. Questionnaires asked teachers to 
report the number of periods they teach 
each week. Mathematics teachers in 
the U.S. most commonly reported 
teaching 26 periods per week. Ger- 
man teachers reported teaching 24, 
and Japanese teachers reported 
teaching 16 periods. Science teach- 
ers in the U.S. and Germany most 
often reported teaching 25 periods per 
week, and Japanese science teachers 18. 
Most mathematics teachers in all three 
countries taught few periods outside of 
their subject, and the same was true of 
science teachers. 

In addition to teaching, U.S. and Japa- 
nese teachers are formally scheduled to 
perform considerable additional duties 
during the school day In the U.S., 
teachers reported that these additional 
responsibilities are primarily in student 
supervision and lesson planning. In Ja- 
pan, the time was roughly balanced be- 
tween student counseling, administra- 
tive duties, and lesson planning. Most 
German teachers were scheduled for 
very few hours of non-teaching tasks 
at school, and they did their lesson plan- 
ning at home. 

Eighth-grade math and science class 
sizes in the U.S. and Germany were 
about the same, averaging 24 to 25 stu- 
dents per class. Japanese math and sci- 
ence classes were much larger, aver- 
aging 37 students. 



The rhythm of U.S. and Japanese teach- 
ers’ daily school life was more similar 
than for their German colleagues. Ob- 
servations of U.S. teachers showed that 
they usually were at school around eight 
hours a day They were expected to be 
in the building during school hours, al- 
though many came earlier, or stayed 
later. Japanese teachers were usually at 
school around nine hours a day They 
were expected to be at school from the 
time it started in the morning until about 
4:00 or 5:00, when student club activi- 
ties end. Many worked later on some 
evenings. Japanese schools also were in 
session fora halfday two Saturdays per 
month. 

German teachers of eighth-grade stu- 
dents spent the shortest amount of time 
at school. The hours during which they 
were in the building usually varied from 
day to day, depending on their teaching 
schedule. During periods when they 
were not scheduled to teach, teachers 
often were not at school and felt free to 
come and go from the school much as 
college professors do in the United 
States. Most returned home when 
school was over around 1:30, ate their 
lunch at home, and planned lessons and 
reviewed student work during the after- 
noon and evening. 

U.S. and German teachers do not have 
the rich informal opportunities to 
learn from each other and to share 
questions about teaching- related is- 
sues that are enjoyed by their Japa- 
nese colleagues. Japanese schools are 
designed with one very large teachers’ 
room, in which all teachers have their 
main desks, and the seating is arranged 
so that all teachers from a particular 
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grade or subject sit near each other. 
When they were not actually instruct- 
ing classes, teachers spent most of 
their time in this large room with their 
colleagues, providing many casual oppor- 
tunities each day to share advice, ideas 
and teaching materials. Japanese cul- 
tural norms expect junior teachers to 
query their older colleagues for teach- 
ing tips and rely on their advice. 

Formal discussions between teach- 
ers were more frequent in Japan, as 
well. When asked how often they 
meet to discuss curriculum, 76 per- 
cent of the teachers of the Japanese 
TIMSS students reported “at least 
once a month,” compared to 60 per- 
cent of the U.S. and 44 percent of the 
German teachers. 

HOW DO TEACHERS LEARN TO 
TEACH? 

U.S. teachers lack the long and care- 
fully mentored introduction to teach- 
ing that Japanese and German teach- 
ers receive. In Germany this period of 
intensive training comes before being 
hired as a teacher. In Japan, it comes 
during the first year on the job. In all 
three countries, prospective teachers first 
take a mixture of courses in education 
and in academic subject areas leading 
to graduation from college. After this, 
however, their experiences diverge 
sharply. 

In Germany, after passing a state ex- 
amination at the end of college, pro- 
spective teachers spend two years in 
student teaching in a program resem- 
bling a traditional apprenticeship. 
During the two years, prospective 
teachers have a reduced teaching 
load that begins with classroom obser- 



vation, then progresses to assisted teach- 
ing, and finally to unassisted teaching 
under the close direction of a mentor 
teacher. They also attend seminars in 
their subjects once or twice a week, and 
their seminar instructor joins the men- 
tor in observing and evaluating the pro- 
spective teacher. At the end of the sec- 
ond year, candidates take another state 
examination and apply for jobs. Place- 
ment is not guaranteed. 

In Japan, after passing the teacher 
certification and employment selec- 
tion examinations, successful candi- 
dates are hired by various prefec- 
tures, which are similar to U.S. 
states. New teachers then undergo 
intensive mentoring and training 
during their first year on the job. New 
teachers’ first year includes at least 60 
days of closely mentored teaching and 
30 days of further training at resource 
centers run by the local and prefectural 
boards of education . Their teaching load 
is reduced to allow time for these activi- 
ties. As is typical of Japanese society, 
mentoring and assistance between jun- 
ior and senior teachers continues 
throughout teachers’ working lives. 

In comparison to the intensive on- 
the-job training that German and 
Japanese teachers receive, U.S. 
teachers’ induction is less structured 
and comprehensive. Prospective U.S. 
teachers typically spend 12 weeks or 
less in student teaching near the end 
of their undergraduate training. Af- 
ter meeting state licensing require- 
ments and being hired by a school 
district, the nature of the induction 
program varies by district, and may 
include some type of in-service train- 
ing, and some mentoring by a more 
experienced teacher. 






FIGURE 12 

Percentage of Eighth-Grade 
Mathematics Teachers 
Reporting That Various Circumstances 
L iMrr Their Teaching 
"Quite a Lot" or “A Great Deal" 
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WHAT CHALLENGES DO 
TEACHERS FACE? 

Although teaching students is their job, 
dealing with students can be teachers’ 
greatest challenge. During interviews, 
teachers in all three countries fre- 
quently described student diversity as 
a challenge. Diversity takes different 
forms in each country, however. U.S. 
teachers referred primarily to differences 
in American students’ social, economic, 
or ethnic background, or to the chal- 
lenges of dealing with non-English- 
speaking students. German teachers re- 
ferred to differences in ethnic back- 
ground, language, and national origin be- 
tween the children of German citizens 
and their country’s foreign workers. 
Japanese teachers referred to the 
wide differences in academic ability 
within each classroom, which arise from 
their nation’s policy of not separating 
students by ability in anyway until high 
school, and not retaining low-perform- 
ing students in grade. 

What circumstances do teachers in the 
three countries believe limit their effec- 
tiveness? TIMSS questionnaires asked 
teachers to rate the extent to which vari- 
ous factors limited their ability to teach. 
Figure 12 on page 52 shows the results. 

Uninterested students and a wide 
range of academic abilities challenge 
teachers in all three countries. Over 
a third of U.S. and German eighth-grade 
teachers also felt that disruptive stu- 
dents limited their effectiveness as 
teachers. The Japanese chose not to 
include any questionnaire items re- 
lating to discipline or morale prob- 
lems in their schools. 



Severe discipline problems and 
threats to student and teacher safety 
are neither widespread nor unique to 

the U.S., despite stories in the popular 
media that sometimes give the impres- 
sion that these problems do not exist in 
other countries. An approximately equal 
and small number of German and U.S. 
eighth-grade teachers reported feeling 
that threats to themselves or their stu- 
dents’ safety limited their effectiveness 
as teachers. Most teachers, however, 
never experience such serious problems. 
Seventy-six percent of the U.S. and 65 
percent of German teachers reported 
that threats to their own or students’ 
safety did not limit their effectiveness 
at all. TIMSS researchers who ob- 
served and interviewed teachers in 
their schools reported that, in both 
countries, the schools with such se- 
rious problems were generally in 
poorer areas of the city. 

Science teachers in all three coun- 
tries reported hindrances similar to 
those of their mathematics col- 
leagues, except that they added short- 
ages of demonstration and instructional 
equipment to the circumstances which 
limit the effectiveness of their teaching. 

Students themselves reported some- 
what more discipline problems than 
their teachers, possibly because chil- 
dren often do not report all incidents 
to school authorities. About 25 per- 
cent of the eighth-graders in both 
Germany and the U.S. reported on 
the questionniares that, during the 
past month, they had been afraid that 
another student might hurt them. 
About 40 percent in each country 
said that one of their friends had been 
hurt by another student. Theft was 






FIGURE 13 

Discipline Problems Eighth-Grade Principals 
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more common in the U.S. than Ger- 
many Fifty-eight percent of U.S. stu- 
dents but only 32 percent of German 
students said that one of their friends 
had something stolen during the past 
month. Skipping classes was more com- 
mon in Germany with 66 percent of Ger- 
man students reporting that one of their 
friends had skipped class during the past 
month, compared with 50 percent in the 
U.S. 

Figure 1 3 on page 54 shows the percent- 
age of U.S. and German principals who 
reported that they dealt with various 
kinds of discipline problems on a daily 
basis. Principals in both countries re- 
sponded that their most common disci- 
pline problems were classroom distur- 
bances, tardiness, and intimidation or 
verbal abuse of students by other stu- 
dents. More serious problems such as 
physical injury of students, teachers, or 



staff were rare. Use of illegal drugs and 
possession of weapons was reported as 
a daily problem by only about 2 percent 
of the U.S. and German principals. Over 
90 percent of principals reported that 
they and their staff dealt with these 
problems rarely or never. 

Teachers in all three countries found 
dealing with student diversity to be a 
challenge to their effectiveness. Many 
German teachers also experienced prob- 
lems with student misbehavior. Many 
teachers in all three countries believed 
their effectiveness was limited by the 
range of student abilities represented in 
their classes, and also by disruptive and 
disinterested students. The next chap- 
ter turns to the questions of how nations 
deal with student ability differences, as 
well as the supports and incentives of- 
fered to students in their academic en- 
deavors. 



CHAPTER 5 : 
STUDENTS ' LIVES 



KEY POINTS: 



Eighth-grade students of different abilities are 
typically divided into different classrooms in 
the U.S., and different schools in Germany. In 
Japan, no ability grouping is practiced. 



In the U.S. students in higher-level 
mathematics classes study different material 
than students in lower-level classes. In 
Germany and Japan, all students study the 
same material, although in Germany, lower- 
level classes study it less deeply and rigorously. 



Japanese eighth-graders are preparing for a 
high-stakes examination to enter high school 
at the end of ninth grade. 



U.S. teachers assign more homework and 
spend more class time discussing it than 
teachers in Germany and Japan. U.S. students 
report about the same amount of out-of- 
school math and science study as their 
Japanese and German counterparts. 



Heavy TV watching is as common among U.S. 
eighth graders as it is among their Japanese 
counterparts. 
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On the surface, the lives of eighth grad- 
ers in most TIMSS countries are fairly 
similar. School and family occupy the 
biggest portions, with friends, TV, 
homework, clubs, and fun added around 
the side. Yet below the surface, the 
way in which societies choose to struc- 
ture the schooling process gives rise to 
different opportunities and expecta- 
tions for young people. The motiva- 
tors, supports, and obstacles to study 
in each country are outgrowths of the 
choices provided by society and 
schools. In each country, the expecta- 
tions which adult society sets for young 
people form a framework within which 
students organize their lives. 



WHAT DOES THE SYSTEM 
REQUIRE OF STUDENTS? 

Some U.S. education policy makers 
have looked admiringly at other nations 
which use periodic gateway examina- 
tions to control student access to the 
next level of education. Such high- 
stakes tests are believed to encourage 
students to study hard. The German 
and Japanese systems are frequently 
cited as examples by the proponents of 
such practices. TIMSS allows us to 
compare the pathways through school- 
ing in these two countries to those of 
our own, to understand how the ex- 
pectations built into the system moti- 
vate students of different ability levels. 



Japan 

Japanese public schools offer a single 
curriculum for all students through 
the end of 9 th grade. Students in el- 
ementary and junior high schools are 
virtually never tracked or grouped by 
academic ability There is a widespread 
belief that, to be fair to all students, 
the nine years of compulsory educa- 
tion must offer the same nationally de- 
termined curriculum to all, regardless 
of individual differences in motivation 
or ability. Until the end of ninth grade, 
there are no gateway exams, and all stu- 
dents are promoted whether or not they 
understand the material. Students who 
are overly or insufficiently challenged 
by classroom assignments may receive 
extra help after school from a teacher, 
or their parents may pay to enroll them 
in a juku, which is a private after-school 
class. In Japan, a substantial amount 
of remedial and enrichment instruction 
is provided by the private sector. 

In mathematics, all eighth-grade 
Japanese students receive a curricu- 
lum heavily focused on algebra and 
geometry. Review of arithmetic is not 
included in the official curriculum goals 
and textbooks. TIMSS observers noted 
that there are differences in students’ 
ability to keep up with the curriculum 
within each classroom, and also be- 
tween schools where students come 
from families with predominantly high 
or low economic backgrounds. How- 
ever, the Japanese system is designed 
such that teachers throughout the coun- 
try strive to meet similar standards for 
presentation of content, while allow- 
ing almost unlimited variation in the 
standards of performance attained by 
students. 



At the end of ninth grade, virtually 
all Japanese students continue on to 
high school. Before they do, how- 
ever, all must take the high school 
entrance exam. This examination cov- 
ers the five core subjects, including 
mathematics and science. Scores on 
the examination serve as a gateway 
which divides students into high, me- 
dium, and low-level high schools on the 
basis of each student’s scores on the 
exam and prior academic performance. 
The best of the graduating ninth-grad- 
ers are accepted at the best academic 
high schools in each city, which pre- 
pare students for application to the 
best universities. The slowest students 
are accepted only by the lesser-ranked 
commercial or vocational high schools, 
which prepare graduates to enter the 
labor force. Students and parents clearly 
understand the consequence of this ex- 
amination at the end of ninth grade 
for future career and life choices. Japa- 
nese students say that the examination 
motivates them to study harder dur- 
ing their junior high school years. For 
the majority of Japanese students, this 
is the only high-stakes exam they will 
experience. 

Once Japanese students enter high 
school, they are again promoted each 
year, until they graduate. Most stu- 
dents then enter the labor force or vo- 
cational training. Approximately one 
third of the high school graduates de- 
cide to apply to a university or two- 
year college, most of which require an 
entrance examination. Competition on 
the entrance examinations for presti- 
gious universities is intense, although 
some lower-ranked colleges will accept 
most high-school graduates who apply. 



Germany 

Various exceptions and experiments 
notwithstanding, the German school 
system basically sorts students into 
one of three types of schools at the 
end of the fourth grade of elemen- 
tary school. This is accomplished 
through a system of gateway examina- 
tions and ability grouping which dif- 
fers considerably from the Japanese. 
Most German students attend one of 
three types of schools: 

■ Gymnasium , which provides a de- 
manding, academic curriculum 
through grade 13 and leads to the 
Abitur exit examination and univer- 
sity study 

■ Realschule which provides a moder- 
ately-paced curriculum ending at 
grade 1 0 and leads to a school-leav- 
ing certificate and vocational train- 
ing or further study at a Gymnasium . 

■ Hauptschule , which provides practi- 
cally-oriented instruction ending at 
grade 9 and leads to a school leaving 
certificate and vocational training 
or employment. Immigrant and 
non-German students are over-rep- 
resented in the Hauptschule . 

The gateway into one of these schools 
is controlled by teacher recommenda- 
tions at the end of fourth grade. Par- 
ents can, and frequently do, override 
teacher recommendations if they be- 
lieve that their child deserves to be 
placed in a higher track. If the student 
is unable to keep up with his class- 
mates, however, he or she will be re- 
tained in grade and after repeated fail- 



ure will be returned to the next lower 
level of schooling. Most German par- 
ents and teachers are relatively com- 
fortable with the fairness of this sys- 
tem, because they believe that it allows 
each child an education best suited to 
his or her abilities, interests and fu- 
ture career. However, there is a sub- 
stantial current of opinion within Ger- 
many which would prefer to delay the 
sorting of students into different school 
types until later in the student’s life, 
and to make it easier for students to 
change upward to a higher school type. 
Most recent policy reforms have made 
small changes to modify the system in 
this direction. 

Classes in grades 5-9 basically cover the 
same content in all three types of Ger- 
man schools, although there is consid- 
erable difference in the depth and rigor 
of instruction between the three school 
types. Typically, Gymnasium students 
receive a theoretical approach, and 
Hauptschule students receive a practical 
approach to the same content. In 
eighth-grade mathematics, the German 
curriculum focuses mostly on Geom- 
etry and Algebra for all three types of 
schools, with some mixture of other 
topics. 

Within most schools, eighth graders all 
follow the same course of study in math 
and science, regardless of their ability 
level. Seventy-five percent of the 
schools reported that they provide only 
one course of study in mathematics, 
and 90 percent provide only one course 
in science. Generally speaking, the Ger- 
man system separates students into dif- 
ferent ability levels primarily between, 
rather than within, schools. 



In Germany, students who have not 
learned the material may be required 
to repeat the grade, or may be moved 
to a less demanding school type. Prin- 
cipals reported that 5 percent of stu- 
dents were required to repeat grade 
eight. Most students finishing the 
Hauptschule at the end of grade 9, or 
Realschule at the end of grade 1 0 receive 
a diploma, and most states do not re- 
quire an exit exam. About 10 percent 
of the students receive only a school- 
leaving certificate instead of a diploma. 
Approximately one- third of German stu- 
dents are enrolled in a Gymnasium , and 
about a quarter of these end their stud- 
ies before taking the Abitur examina- 
tion at the end of 13 th grade. Very few 
students who sit for the Abitur fail it, 
although those with a lower score may 
not be able to enter their chosen uni- 
versity or field of study. 

United States 

It is more difficult to generalize about 
the United States, because practices dif- 
fer among the thousands of school dis- 
tricts in the country. Generally speak- 
ing, however, wi thin-class grouping or 
individuation of instruction is fairly 
common in elementary schools in the 
subjects of reading and mathematics. 
In middle schools and high schools, 
students are frequently grouped by 
ability into different mathematics 
classes. In the U.S., 80 percent of 
principals of eighth graders reported 
that they provided different ability- 
based classes in mathematics, but only 
17 percent reported this in science. 
Course content and textbooks usually 
differ between the higher and lower- 
level classes. In the eighth grade, 



lower-level classes typically focus on 
a review of arithmetic and other ba- 
sic skills with a small amount of al- 
gebra. Higher-level classes focus 
more heavily on algebra, with a small 
amount of geometry. 

In the U.S., educational expectations 
and teaching standards can also differ 
substantially between communities, 
based on a neighborhood’s economic 
status and parental expectations for 
their children’s futures. Minority stu- 
dents are over-represented in lower- 
level classes and in schools in poorer 
areas. 

There are various procedures for deal- 
ing with students who teachers judge 
have not learned the course material. 
They may be promoted anyway, retained 
in grade, moved to a lower-tracked 
class, or given remedial assistance. 
Principals reported that 4 percent of 
the students in their schools were re- 
quired to repeat grade eight. 

Generally speaking, the U.S. system does 
not have high-stakes gateway examina- 
tions which regulate entrance to fur- 
ther schooling before the end of twelfth 
grade. Seventeen states currently have 
an exit examination as a requirement 
for high-school graduation. In most 
cases, this is a minimum-competency 
test. Students may take the test sev- 
eral times if necessary, and few students 
repeatedly fail. Scores on college en- 
trance examinations such as the SAT 
and ACT are given considerable weight 
by most selective universities, although 
non-selective schools may not require 
them at all. 



This section has examined the learning 
expectations embedded in the school 
systems in the three countries. Japan 
is the only one of the three coun- 
tries which requires a high-stakes 
entrance examination for all stu- 
dents. Mathematics and science are 
included on this examination, and Japa- 
nese eighth-graders are therefore likely 
to be studying these subjects harder 
than usual in preparation. Methods of 
sorting students by ability into schools 
and classes differ among the three coun- 
tries, but both Germany and Japan 
teach algebra and geometry to all of 
their eighth-grade students, although 
the level of rigor may differ by track. 
In contrast, in the U.S. a heavy fo- 
cus on algebra is usually reserved for 
students in the higher tracks, and 
few U.S. eighth-graders in any track 
study much geometry. 

In all three countries, the standards of 
performance for students at each grade 
level are set in such a way that almost 
all students are passed from one grade 
to the next, and all who complete sec- 
ondary education can obtain some type 
of secondary school diploma, regard- 
less of their level of academic ability 



HOW DO STUDENTS SPEND 
THEIR TIME DURING SCHOOL? 

United States 

U.S. students attend school approxi- 
mately 180 days per year, five days per 
week. Each day, school usually runs 
from about 8:00 in the morning until 





mid-afternoon, with a lunch break and 
five to seven-minute breaks between 
classes. Schools vary in how they orga- 
nize students. Middle schools com- 
monly include either grades 7-9, or 6- 
8, although variations exist. In some 
schools, the student body is subdivided 
into “houses” or “blocks” which include 
several classes of students and a single 
group of teachers, to strengthen conti- 
nuity in student-teacher and student- 
student relationships. In other schools, 
students change teachers and classmates 
at the end of each period. 

Most U.S. schools offer a variety of 
teacher-led after-school activities, in- 
cluding sports, music, art, theater, and 
academic clubs. The range of after- 
school activities varies by school and 
often reflects the district’s and school’s 
resources and socioeconomic status. 
Participation in clubs is voluntary, and 
students can participate in more than 
one activity, as some are seasonal or do 
not meet every day. Ten percent of U.S. 
students said that they participate in 
some type of math or science club each 
week. 

Germany 

German students attend school ap- 
proximately 188 days per year. School 
usually starts around 7:45 in the morn- 
ing, and ends around 1:15, with 10 to 
25 minute breaks between classes. 
There is no lunch period, and most stu- 
dents return home for lunch. Gymna- 
sium usually include students from 
grades 5-13, Realschule grades 5-10, and 
Hauptschule grades 5-9. Eighth-grade 
students remain together throughout 
the day, with teachers changing class- 
rooms. Classes are usually kept to- 
gether for several years and develop a 
strong sense of unity 



Most German schools offer few extra- 
curricular activities. Schools visited by 
TIMSS observers offered mostly sports, 
arts, and student government. Student 
participation was low, and some clubs 
rarely met. Six percent of German stu- 
dents said that they participate in a 
math or science club each week. Over 
half of all German students under the 
age of 15 are involved in organized 
sports, but these are sponsored by a 
national organization’s local sports clubs 
rather than the school. 

Japan 

Japanese schools are in session 220 days 
per year, five days per week, and two 
Saturday mornings per month. School 
usually starts at 8:00 in the morning 
and ends in the middle of the after- 
noon, with a lunch break, 5 to 15 
minute breaks between various peri- 
ods, and a homeroom meeting at the 
beginning and end of each day. The 
number of classes per day is frequently 
reduced for special seasonal events, 
school-wide meetings, and other activi- 
ties. Junior high schools include grades 
7-9. Students in a given class remain 
together throughout the day, and a dif- 
ferent teacher for each subject comes 
to the students’ classroom. 

Extracurricular or “club” activities are 
a very important part of Japanese 
eighth-graders’ lives, and well over half 
of all students participate. Clubs meet 
daily throughout the year from the time 
that classes are over until about 5:00 
or 6:00. Four percent of Japanese stu- 
dents reported participating in a math 
or science club. 



In contrast to their German and U.S. 
counterparts, Japanese junior-high 
school students are required to wear 
uniforms to school, and must follow a 
strict dress code. Regular uniform in- 
spections chastise such deviations as 
non-regulation belts, shoes, hairstyles, 
jewelry, and non-regulation book bags. 
The students themselves play a major 
role in the enforcement of school rules 
and discipline. Between students, there 
is a complicated senior-junior system 
of deference and behavior training. 
Younger students speak to students in 
upper grades using the respectful term 
sempai (upper-class man/woman). Par- 
ticularly within the clubs, upper-class 
students are in charge of overseeing the 
younger students. 



HOW MUCH STUDY DO 
STUDENTS DO AFTER SCHOOL? 

Study at home is not the same as home- 
work. Ideally, students would be self- 
motivated to study mathematics and 
science more than the minimum re- 
quired by homework assignments. The 
degree to which this actually happens 
depends on the individual student, and 
the degree to which the culture encour- 
ages or requires eighth -graders to take 
responsibility for their own learning. 

Interviews with students about their 
daily lives found that, in all three coun- 
tries, most students tended to put in 
extra non-assigned study before exami- 
nations and relax after they were fin- 
ished. In Germany and the U.S., the 
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only tests with some consequences for 
students’ academic lives were periodic 
teacher-prepared in-class examinations. 
There were broad similarities across 
countries in students’ strategies of 
study for these examinations. High- 
achieving students described doing ex- 
tra hours of non-assigned review and 
preparation, while this was much less 
common among low achievers. In Ja- 
pan, consciousness about the examina- 
tions at the end of ninth grade caused 
all eighth graders to be mindful of the 
need for extra personal study and prepa- 
ration, although high achievers were 
more likely to translate this into sub- 
stantial home study. 

Most Americans believe that home- 
work is an important part of the learn- 
ing process. Some have recommended 
assignment of more homework as a 
means of improving mathematics 
achievement. It is frequently assumed 
that teachers in high-achieving coun- 
tries assign more homework than do 
U.S. teachers. 

However, TIMSS found that Japanese 
teachers actually assigned less home- 
work than U.S. and German teach- 
ers. The teacher questionnaire results 
and videotapes of classroom practices 
both agree on this finding. Figure 14 
on page 62 shows that 86 percent of 
U.S. mathematics and 75 percent of 
German teachers assigned homework 
3 to 5 times per week, in comparison 
to 21 percent of Japanese teachers. 
When asked about the amount of 
homework they assign, U.S. and Ger- 
man math teachers’ most common re- 
sponse was about thirty minutes or less, 
three or more times per week. Japa- 
nese teachers typically assigned the 



same amount, but once or twice per 
week. 

U.S. and German teachers not only 
assign more homework than Japa- 
nese, but they also spent more class 
time talking about or doing it. Time 
spent on assigning, working on, or shar- 
ing homework occupied 1 1 percent of 
U.S. and 8 percent of German lessons, 
in comparison to 2 percent of Japa- 
nese lessons. Furthermore, most U.S. 
teachers reported that they counted 
homework toward student grades, 
whereas this practice was not common 
in Germany and Japan. It was only in 
the U.S. that some teachers allocated 
class time for students to begin their 
homework in class. 

The picture changes, however, when stu- 
dents themselves were asked how much 
time they spend studying math and sci- 
ence. On average, Japanese, German, 
and U.S. students reported that they 
spent about the same amount of time 
each day — between 30 minutes and 
an hour — studying mathematics 
outside of school, and about the 
same amount studying science. These 
questionnaire findings are in line with 
what interviewers found when they 
spoke with eighth graders in each coun- 
try about their study habits. 

Between 30 minutes and an hour of 
after-school study per night is an aver- 
age in each country. Of course there 
were wide differences between students 
everywhere in how willing they were 
to complete assignments or go beyond 
them in extra personal study. Some 
German, Japanese, and U.S. teachers 
noted that low-achieving students, par- 
ticularly those from troubled family 



backgrounds were less likely to com- 
plete assignments, either because they 
lacked the motivation, or did not have 
a family environment which was con- 
ducive to home study. In contrast, 
some high-achieving students in each 
country engaged in extra study beyond 
what was assigned. 

If Japanese teachers assigned less home- 
work than German and U.S. teachers, 
but Japanese students reported that 
they studied about as much as their 
counterparts in these countries, how 
were typical Japanese students moti- 
vated and supported in this extra 
study? Researchers who observed and 
interviewed in Japanese schools and 
homes reported that parents, teachers, 
and friends encouraged students to 
study hard during their eighth and 
ninth grade years in preparation for the 
high school entrance examinations. 
Students are believed to have consid- 
erable personal responsibility for this 
process. Some popular teen magazines 
even run articles on how to devise a 
personal study and review plan. Japa- 
nese students described a combination 
of peer support and competition that 
encouraged them to study harder dur- 
ing these years. For students who en- 
ter a commercial or vocational high 
school, however, extra study tends to 
fall off again after entrance to high 
school. 

Another important source of outside 
assistance for Japanese students is the 
juku, which are private after-school 



classes offered in a variety of subjects 
to help slower students catch up, or 
faster students study in more depth to 
prepare for entrance examinations. 
Parents must pay to send their chil- 
dren to these private classes, which are 
run by companies or neighborhood tu- 
tors. Researchers reported that some 
mothers take an extra job to provide 
the tuition. Although the purpose of 
juku is academic, students enjoy attend- 
ing them, because they are able to 
spend time with their friends walking 
or riding subway trains to and from 
the classes. Sixty-four percent of Japa- 
nese eighth graders reported attend- 
ing weekly extra lessons in math, and 
41 percent in science. Most students 
attend juku one or two hours per week. 
Attendance drops off substantially once 
high school entrance examinations are 
completed. Other types of non-aca- 
demic after-school classes, such as mu- 
sic or marital arts, were also popular 
among Japanese students. 

Japanese experts report that instruc- 
tion in mathematics juku focuses more 
on review and practice of basic skills 
than is typical of Japanese classrooms. 
This assists slower students who need 
review of prior material, and provides 
all students extra practice with con- 
cepts learned but not drilled upon in 
class. Although more systematic study 
of juku instruction is needed, the hy- 
pothesis might be entertained that 
Japanese students benefit from the dif- 
ferent but complementary nature of 
juku and classroom instruction. 



WHAT DO STUDENTS THINK 
ABOUT MATHEMATICS AND 
SCIENCE? 

At least half the students in Ger- 
many, Japan, and the U.S. reported 
that they like math and science. In 

the U.S., boys and girls were equally 
positive, but German and Japanese girls 
were less positive than boys in those 
countries. 

How much students like math and sci- 
ence is a different question. Students 
in all three countries were more in- 
clined to agree that that it was im- 
portant to have time to have fun 
than that to do well in mathematics 
and science. More students in the U.S. 
also agreed that it was important to 
do well in sports than to do well in 
math and science. In Germany and Ja- 
pan, however, fewer students consid- 
ered it important to do well in sports 
than in mathematics. 

Japanese policy makers are currently 
discussing an emerging social phenom- 
enon they term risu kirai, or “dislike of 
mathematics and science.” Although 
much discussed among Japanese ex- 
perts, it is not clear how widespread 
this phenomenon is in Japan. About 
10 percent of Japanese students re- 
ported that they disliked mathematics 
“a lot,” which was comparable to the 
number of U.S. students who reported 
strongly disliking the subject. Inter- 
views with Japanese students who dis- 
liked the subject suggest that they dis- 
liked it because they saw it as difficult 
and uninteresting. Japanese teachers 
speculated that many of these students 
may have fallen behind in earlier grades 
and never caught up. The teachers 
thought that the demanding pace of 
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the curriculum and the need to keep 
instruction focused on the material 
which will be covered on the high school 
entrance examination caused students 
to fall behind. 

Most Japanese students experience 
mathematics and science as difficult. 

Eighty-seven percent disagreed with the 
statement “math is an easy subject,” 
and 85 percent disagreed with a simi- 
lar statement in science. About half of 
U.S. students on the other hand, re- 
ported that math and science are easy 
Given the findings reported in Chap- 
ter 3 that the U.S. mathematics cur- 
riculum focuses on easier topics, and 
that classroom activities are based 
mostly on routine procedures rather 
than conceptual thinking, the hypoth- 
esis might be entertained that U.S. stu- 
dents’ classroom experiences, at least 
in mathematics, lead them to believe 
that these subjects are easy. 



WHAT DO STUDENTS DO AFTER 
SCHOOL BESIDES STUDY? 

What other choices and opportunities 
do societies offer their eighth-graders 
besides focus on school and study? The 
way in which societies structure the 
choices available to young people shows 
something about the priority assigned 
to schooling and the society’s invest- 
ment in education. 

Figure 15 on page 65 shows thateighth- 
graders in all three countries were 
more likely to spend extended peri- 
ods after school watching television 
or videos, playing with friends, or en- 
gaging in sports than taking part in 
more academically-related activities. 



Students who watched a lot of televi- 
sion each day after school were fairly 
common in all three countries, espe- 
cially the U.S. and Japan. After-school 
sports were more popular in the U.S 
than in Germany or Japan. Almost one 
third of U.S. eighth-graders reported 
spending three hours per day engaged 
in sports activities. In Germany, 
friends were more popular than televi- 
sion. Two- thirds of German students 
spent at least three hours per day play- 
ing with friends, possibly because Ger- 
man schools finish before lunch, and 
students have more time to spend with 
their friends in the afternoon. Very 
few students in any of the three coun- 
tries spent extended periods of time 
reading books for fun or studying school 
subjects. 

The priorities that nations assign to 
schooling are evident in the opportu- 
nities provided for students outside of 
school. Japan tries to encourage eighth- 
graders to focus primarily on school, 
family, and study. In contrast to U.S. 
and German schools, Japanese schools 
set and enforce policies for behavior 
off school grounds. Examples include 
policies regarding curfews; clothing to 
be worn in public; use of bicycle hel- 
mets: and prohibitions against enter- 
ing game arcades, dating, employment, 
smoking, and alcohol. In some towns, 
teachers and parents check shopping 
malls, parks, and other areas where stu- 
dents are likely to congregate to moni- 
tor student compliance with the rules. 
These policies may contribute to Japa- 
nese students’ reports that they spent 
less time with their friends than Ger- 
man and U.S. teenagers. 



In the U.S. and Germany, working at a 
paid job was not uncommon even for 
eighth graders. About a quarter of all 
students in these countries reported 
that they worked at a paid job before 
or after school at least an hour per 
week. In Japan, this percentage was 4 
percent. 

In summary, eighth-graders’ lives in 
Germany, Japan, and the U.S. share 



broad similarities in their focus on 
school, friends, TV and sports. How- 
ever, the way in which each society has 
designed its schooling process, and the 
expectations that it sets for students 
provide different motivators, supports, 
and distractions from study. Consid- 
ering the choices that other nations 
have made in this regard may help us 
to better understand our own. 








CONCLUSIONS 



KEY POINTS: 



No single factor can be considered to 
influence student performance in isolation 
from other factors. There are no single 
answers to complex questions. 



The content of U.S. eighth-grade 
mathematics classes is not as challenging as 
that of other countries, and topic coverage is 
not as focused. 



Most U.S. mathematics teachers report 
familiarity with reform recommendations, 
although only a few apply the key points in 
their classrooms. 



Evidence suggests that U.S. teachers do not 
receive as much practical training and daily 
support as their German and Japanese 
colleagues. 



3 BEST COPY AVAILABLE 

ERIC 



This report has presented highlights 
from initial analyses of U.S. eighth- 
graders in international perspective. 
These findings lightly sketch only a cor- 
ner of the entire picture of U.S. per- 
formance in mathematics and science 
which will be painted over the next 
years as further analysis of the eighth- 
grade data is carried out and findings 
from grades four and twelve are added. 

This section looks across the findings 
presented in the previous pages for in- 
sights into the key questions with 
which the study started: How do our 
eighth-graders compare to their inter- 
national counterparts? What have we 
learned about mathematics achieve- 
ment and the factors that may be asso- 
ciated with it? What have we learned 
about science? What have we learned 
about how our education system as a 
whole compares to that of other coun- 
tries? 

Looking for insights into factors asso- 
ciated with student performance is 
complicated because achievement af- 
ter eight years of schooling and thir- 
teen years of life is the product of many 
different influences. Furthermore, edu- 
cation in our country is a vast system 
with many interrelated parts. No 
single factor can be properly consid- 
ered in isolation from others. Real- 
izing that there are no single answers 
to complex questions, let us review 
the data. 



WHERE DO WE STAND? 

The U.S. is far from being among the 
top nations of the world in mathemat- 
ics and science. We are far from this 



goal. Singapore, Korea, Japan, the 
Czech Republic, and Hungary outper- 
form us in both subjects. Particularly 
in mathematics, our students lag far 
behind top-ranking countries. Com- 
pared to our goal of excellence 
among nations, we are not where we 
aim to be. 

However, we are on a par with many 
of our international trading partners. 

Our students stand not far from the 
international average: somewhat below 
in mathematics, and somewhat above 
in science. Our math scores are not 
significantly different than those of Ger- 
many and England. Our science scores 
are not significantly different than 
those of Germany, England, Canada, and 
Russia. We rank near the middle of 
the 41 TIMSS countries, among other 
nations to whom we frequently com- 
pare ourselves. 



WHAT HAVE WE LEARNED 
ABOUT MATHEMATICS? 

Our eighth graders score below the in- 
ternational average in mathematics. 
Although international comparisons 
over time are difficult, there does not 
appear to have been much improve- 
ment during the past three decades in 
U.S. students’ international standing in 
this subject. The following factors may 
be associated with this performance: 

■ The content of U.S. eighth-grade 
mathematics classes is not as 
challenging as that of other coun- 
tries. 

U.S. eighth-grade curriculum and in- 
struction both appear .to be less chal- 



lenging than those in other coun- 
tries. Concerning curriculum, top- 
ics covered in U.S. mathematics 
classrooms are at a seventh-grade 
level in comparison to other coun- 
tries. Virtually all German and Japa- 
nese students study algebra and ge- 
ometry in the eighth grade, while in 
the U.S., only students in higher-level 
classes receive significant exposure 
to algebra, and few students study 
geometry 

Concerning instruction, the content 
of U.S. classes requires less high-level 
thought than classes in Germany and 
Japan. The sequence of mathemati- 
cal ideas used in lessons was judged 
to be of low quality in a majority of 
U.S. classrooms, while this was less 
frequently the case in the other two 
countries. 

■ Topic coverage is not as focused 
in U.S. eighth-grade mathematics 
classes as in the classrooms of 
other countries. 

In the U.S., curriculum is deter- 
mined at the state and local level, 
which is atypical among TJMSS 
countries, most of whom determine 
curriculum nationally. In all grades 
1-8, the U.S. mathematics curricu- 
lum recommends coverage of more 
topics than the international aver- 
age. U.S. mathematics lessons also 
include a greater number of topics 
and activities than those in Germany 
and Japan. 

■ Most U.S. eighth-grade math 
teachers report familiarity with 
reform recommendations, al- 
though only a few apply the key 
points in their classrooms. 



Ninety-five percent of U.S. eighth- 
grade mathematics teachers say that 
they are aware of current ideas about 
teaching and learning mathematics. 
Most believe that the lessons they 
teach exemplify elements of the rec- 
ommendations. However, the way 
in which U.S. teachers understand 
and implement these recommenda- 
tions suggests that they are focus- 
ing on isolated techniques rather 
than the central message that teach- 
ing and learning should involve high- 
level mathematical thought. Our 
mathematics teachers’ typical goal 
is to teach students how to do some- 
thing, rather than how to think 
about and understand mathemati- 
cal concepts. In a variety of respects, 
Japanese mathematics teaching more 
closely resembles the recommenda- 
tions of the U.S. reform movement. 



WHAT HAVE WE LEARNED ABOUT 
SCIENCE? 

U.S. eighth graders score above the in- 
ternational average in science. In the 
three previous international science as- 
sessments, the U.S. scored below the 
international average. Because com- 
parisons of different international as- 
sessments over time are difficult, cau- 
tion should be exercised in assuming 
that there has been significant improve- 
ment in our international standing in 
science, but it is a possibility. 

This initial report contains less infor- 
mation about science than about math- 
ematics because the questionnaire data 
have not yet been fully analyzed, and 
the videotape study of classroom in- 
struction was conducted only in math- 




ematics. Furthermore, because we are 
unable to use multiple research meth- 
ods to verify the science findings from 
different perspectives, our findings are 
more tentative than for mathematics. 

Fuller description of eighth-grade sci- 
ence teachers’ instructional practices 
must await further questionnaire analy- 
sis. 



WHAT HAVE WE LEARNED ABOUT 
U.S. EDUCATION AS A WHOLE? 

T1MSS provides several insights about 
U.S. eighth-grade teachers and stu- 
dents, which are true of both math- 
ematics and science education. 

■ Evidence suggests that U.S. teach- 
ers do not receive as much practi- 
cal training and daily support as 
their German and Japanese col- 
leagues. 

In contrast to new German and Japa- 
nese teachers, new U.S. teachers do 
not receive a long-term structured 
apprenticeship in their profession. 
Once on the job, they have fewer 
formal and informal opportunities 
to discuss and share teaching-related 
issues and questions. Schools are 
managed in such a way that lessons 
are frequently interrupted by loud- 
speaker announcements or visitors 
at the door. 

■ Our eighth-graders spend at least 
as much time studying mathemat- 
ics and science as students in Ger- 
many and Japan. 



During school, our eighth graders 
spend more hours in mathematics 
and science classes per year than stu- 
dents in Germany and Japan. U.S. 
teachers assign more homework, and 
spend more class time discussing it 
than teachers in those countries. 
Outside of school, our students re- 
port doing about as much math and 
science-related homework and other 
study as German and Japanese stu- 
dents, although most Japanese eighth 
graders also attend after-school 
classes in mathematics for an hour 
or two per week in preparation for 
the entrance exams to high school. 



QUESTIONS FOR FURTHER STUDY 

The initial findings described in this 
report raise many important questions 
for further study. Some of these may 
be answered through continued analy- 
sis of the eighth-grade data. Others 
must await the design of future inter- 
national studies. For this reason, 
T1MSS is an important national re- 
source for secondary analysis and fur- 
ther research. Some examples are: 

■ Why is our international stand- 
ing lower in mathematics than in 

science? 

Deeper analysis of the T1MSS data 
will help us to compare the curricu- 
lum and instructional practices used 
in mathematics with those in sci- 
ence, to better understand the simi- 
larities and differences. 
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■ How is student achievement re- 
lated to curriculum coverage? 

Comparison of the curriculum analy- 
sis with achievement scores in the 
various content areas can illuminate 
the degree to which our students’ 
performance in algebra, earth sci- 
ence, and other content areas is re- 
lated to curricular emphasis in these 
areas. 

■ Does mathematics teaching in 
high performing countries re- 
semble the reform movement’s rec- 
ommendations? 

The videotape study found that in 
many ways, Japanese mathematics 
teaching resembles the recommen- 
dations of the U.S. reform move- 
ment more closely than does U.S. 
and German teaching. Is this an im- 
portant factor in understanding why 
Japan also scores among the top na- 
tions of the world in mathematics? 
Undertaking similar videotape ob- 
servational studies of other high-per- 
forming nations and further analy- 
sis of the TIMSS teacher question- 
naire data could provide insight into 
this question. 



TIMSS' LONG TERM UTILITY TO 
THE NATION 

TIMSS is not an answer book, but a 
mirror through which we can see our 
own education system in international 
perspective. It helps us view with new 
eyes those aspects of our system which 
we may take for granted. Its findings 
make us think more deeply about the 
cultural assumptions and unconscious 
choices which form the underpinnings 
of our society’s approach to schooling. 
We come to understand our own sys- 
tem better by comparing it to others. 
Careful study of our country’s reflec- 
tion in the mirror of international com- 
parisons can provide information to 
assist educators, business leaders, 
teachers, and parents as they guide our 
nation in the pursuit of excellence. 
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APPENDIX 3 



National Average Scores and Standard Errors 



The 95 percent “plus or minus" confidence interval around each 
nation’s score is two times the standard error. 



Country 


Average 


Standard 


Average 


Standard 






Error 




E RROR 


(AUSTRALIA) 


530 


4.0 


545 


3.9 


(AUSTRIA) 


539 


3.0 


558 


3.7 


8ELGIUM-FLEMISH ° 


565 


5.7 


550 


4.2 


(8ELG1UM-FRENCH) 


526 


3.4 


471 


2.8 


(8ULGARIA) 


540 


6.3 


565 


5.3 


CANADA 


527 


2.4 


531 


2.6 


(COLOM8IA) 


385 


3.4 


41 1 


4.1 


CYPRUS 


474 


1.9 


463 


1.9 


CZECH REPU8LIC 


564 


4.9 


574 


4.3 


(DENMARK) 


502 


2.8 


478 


3.1 


ENGLAND *° 


506 


2.6 


552 


3.3 


FRANCE 


538 


2.9 


498 


2.5 


(GERMANY) *° 


509 


4.5 


531 


4.8 


(GREECE) 


484 


3.1 


497 


2.2 


HONG KONG 


588 


6.5 


522 


4.7 


HUNGARY 


537 


3.2 


554 


2.8 


ICELAND 


487 


4.5 


494 


4.0 


IRAN, ISLAMIC REPU8LIC 


428 


2.2 


470 


2.4 


IRELAND 


527 


5.1 


538 


4.5 


(ISRAEL) * 


522 


6.2 


524 


5.7 


JAPAN 


605 


1.9 


571 


1.6 


KOREA 


607 


2.4 


565 


1 .9 


(KUWAIT) 


392 


2.5 


430 


3.7 


LATVIA (LSS) ° 


493 


3.1 


485 


2.7 


LITHUANIA * 


477 


3.5 


476 


3.4 


(NETHERLANDS) 


541 


6.7 


560 


5.0 


NEW ZEALAND 


508 


4.5 


525 


4.4 


NORWAY 


503 


2.2 


527 


1.9 


PORTUGAL 


454 


2.5 


480 


2.3 


(ROMANIA) 


482 


4.0 


486 


4.7 


RUSSIAN FEDERATION 


535 


5.3 


538 


4.0 


(SCOTLAND) 


498 


5.5 


517 


5.1 


SINGAPORE 


643 


4.9 


607 


5.5 


SLOVAK REPU8UC 


547 


3.3 


544 


3.2 


(SLOVENIA) 


541 


3.1 


560 


2.5 


(SOUTH AFRICA) 


354 


4.4 


326 


6.6 


SPAIN 


487 


2.0 


517 


1.7 


SWEDEN 


519 


3.0 


535 


3.0 


SWITZERLAND ° 


545 


2.8 


522 


2.5 


(THAILAND) 


522 


5.7 


525 


3.7 


UNITED STATES ° 


500 


4.6 


534 


4.7 


INTERNATIONAL AVERAGE 513 




516 





NOTES: 

1. Nations not meeting international guidelines are shown in parentheses. 

2. Nations in which more than 10 percent of the population was excluded from testing are shown with a Latvia 
is designated LSS because only Latvian-speaking schools were tested, which represents less than 65 percent of the 
population. 

3. Nations in which a participation rate of 75 percent of the schools and students combined was achieved only after 
replacements for refusals were substituted, are shown with a°. 

4. The international average is the average of the national averages of the 41 nations. It has no standard error. 

SOURCE; 

Beaton etal.(l996) Mathematics och/evement in the midd/e schoo/ yeors. Table 1.1. Boston College: Chestnut Hill.MA,. 

Beaton et al. ( 1 996) Science ochievement in the middle school years. Table 1 .1 . Boston College: Chestnut Hill. MA. 



ERIC , 









APPENDIX 4 

SUMMARY OF NATIONAL DEVIATIONS FROM 
INTERNATIONAL STUDY GUIDELINES 



Twenty-two of the 41 TIMSS countries 
experienced a more or less serious de- 
viation from international guidelines 
for execution of the study. In 1 6 coun- 
tries, the TIMSS International Study 
Center considered the deviations to be 
sufficiently serious to raise questions 
about the confidence to be placed in 
their scores. These 16 nations with 
major difficulties are noted with an 
asterisk in this appendix, and with pa- 
rentheses in Figures 1,2,3, 5, and 6 in 
this report. 

* Australia - Participation rate did not 
meet the international criterion of 75 
percent of schools and students com- 
bined. Participation rate was 70 per- 
cent after replacements for refusals 
were substituted. 

* Austria - Participation rate did not 
meet the international criterion of at 
least 50 percent participation by schools 
before replacement. The initial par- 
ticipation rate was 41 percent before 
replacement. Participation rate was 80 
percent after replacements for refusals 
were substituted. 

* Belgium (Flemish) - Participation rate 
of 75 percent of schools and students 
combined was achieved only after re- 
placements for refusals were substi- 
tuted. 

Belgium (French) - Participation rate 
did not meet the international crite- 
rion of 75 percent of schools and stu- 
dents combined. Participation rate was 
72 percent after replacements for re- 
fusals were substituted. 



* Bulgaria - Participation rate did not 
meet the international criterion of 75 
percent of schools and students com- 
bined. Participation rate was 63 per- 
cent after replacements for refusals 
were substituted. 

^Colombia - The pair of grades tested 
was one grade higher than the interna- 
tional target. Average age of students 
in the upper grade was 15.7. 

* Denmark - International guidelines re- 
quiring random selection of the class- 
rooms to receive the assessment were 
not followed. 

England - More than the international 
criterion of ten percent of schools and 
students were excused from the test 
for various reasons with resulting cov- 
erage of 89 percent of the desired popu- 
lation. Participation rate of 75 per- 
cent of schools and students combined 
was achieved only after replacements 
for refusals were substituted. 

* Germanv - The pair of grades tested 
was one grade higher than the interna- 
tional target. Average student age of 
students in the upper grade was 14.8. 
One of sixteen regions (Baden- 
Wuerttemberg) did not participate in 
the study, with resulting coverage of 88 
percent of the desired population. Par- 
ticipation rate of 75 percent of schools 
and students combined was achieved 
only after replacements for refusals were 
substituted. 

^Greece - International guidelines re- 
quiring random selection of the class- 
rooms to receive the assessment were 
not followed. 





* Israel - Test administered only in the 
Hebrew-speaking public school system, 
with resulting coverage of 74 percent 
of the desired population. International 
guidelines requiring random selection 
of the classrooms to receive the assess- 
ment were not followed. Participation 
rate did not meet the international cri- 
terion of at least 50 percent participa- 
tion by schools in the sample before 
replacement. The participation rate 
before replacement was 45 percent. 

* Kuwait - In contrast to other nations, 
which tested two adjacent grades, Ku- 
wait tested only one grade; the ninth 
grade. This grade was higher than ei- 
ther of the grades which should have 
been the international target. Average 
student age was 15.3. 

Latvia (LSS ) - Test administered only 
in Latvian-speaking schools, with result- 
ing coverage of 51 percent of the de- 
sired population. Because coverage falls 
below the international 65 percent 
population-coverage criterion, Latvia is 
designated (LSS) for Latvian Speaking 
Schools. 

Lithuania - Test administered only in 
Lithuanian-speaking schools, with re- 
sulting coverage of 84 percent of the 
desired population. 

* Netherlands - Participation rate did 
not meet the international criterion of 
at least 50 percent participation by 
schools before replacement. The ini- 
tial participation rate before replace- 
ment was 24 percent. 



* Romania - The pair of grades tested 
was one grade higher than the interna- 
tional target. Average student age in 
the upper grade was 14.6. 

* Scotland - Participation rate did not 
meet the international criterion of 75 
percent of schools and students com- 
bined. Participation rate was 73 per- 
cent after replacements for refusals 
were substituted. 

* Slovenia - The pair of grades tested 
was one grade higher than the interna- 
tional target. Average student age was 
14.8. 

* South Africa - International guidelines 
requiring random selection of the class- 
rooms to receive the assessment were 
not followed. Participation rate did not 
meet the international criterion of 75 
percent of schools and students com- 
bined. Participation rate was 62 per- 
cent after replacements for refusals 
were substituted. 

Switzerland - Test administered in 22 
of 26 cantons, with resulting coverage 
of 86 percent of the desired popula- 
tion. 

* Thailand - International guidelines re- 
quiring random selection of the class- 
rooms to receive the assessment were 
not followed. 

United States - Participation rate of 
75 percent of schools and students com- 
bined was achieved only after replace- 
ments for refusals were substituted. 
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